-- Logs begin at Thu 2022-02-10 02:55:46 UTC, end at Thu 2022-02-10 03:53:40 UTC. -- Feb 10 03:28:53.563829 dv-cinder-828060-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 10 03:28:53.573240 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Feb 10 03:28:53 2022] *** Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: nodename: dv-cinder-828060-2-iscsi Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: machine: x86_64 Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: clock source: unix Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: pcre jit disabled Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: detected number of CPU cores: 4 Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: current working directory: / Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: detected binary path: /usr/bin/uwsgi-core Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: your processes number limit is 47680 Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: your memory page size is 4096 bytes Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: detected max file descriptor number: 2048 Feb 10 03:28:53.575295 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: lock engine: pthread robust mutexes Feb 10 03:28:53.576101 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: thunder lock: enabled Feb 10 03:28:53.576101 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 10 03:28:53.576101 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 10 03:28:53.622357 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: Python main interpreter initialized at 0x55e8302cc9c0 Feb 10 03:28:53.622357 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: python threads support enabled Feb 10 03:28:53.622357 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: your server socket listen backlog is limited to 100 connections Feb 10 03:28:53.622357 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: your mercy for graceful operations on workers is 90 seconds Feb 10 03:28:53.622809 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: mapped 403077 bytes (393 KB) for 2 cores Feb 10 03:28:53.622809 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: *** Operational MODE: preforking *** Feb 10 03:28:53.623057 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: *** uWSGI is running in multiple interpreter mode *** Feb 10 03:28:53.623057 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: spawned uWSGI master process (pid: 101991) Feb 10 03:28:53.623285 dv-cinder-828060-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 10 03:28:53.625730 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: spawned uWSGI worker 1 (pid: 101994, cores: 1) Feb 10 03:28:53.625730 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: spawned uWSGI worker 2 (pid: 101995, cores: 1) Feb 10 03:28:53.625730 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 10 03:28:55.397269 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:28:55.397269 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: from cryptography.utils import int_from_bytes Feb 10 03:28:55.398065 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:28:55.398065 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: from cryptography.utils import int_from_bytes Feb 10 03:28:55.398183 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:28:55.398183 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: from cryptography.utils import int_from_bytes Feb 10 03:28:55.398618 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:28:55.398618 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: from cryptography.utils import int_from_bytes Feb 10 03:28:57.978161 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 03:28:57.978814 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 03:28:57.978891 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 03:28:57.979221 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 03:28:57.979469 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 03:28:57.979621 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 03:28:57.980043 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.980152 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 03:28:57.980241 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.980401 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 03:28:57.980494 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.980766 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.980858 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 03:28:57.981025 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 03:28:57.981154 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.981393 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.981529 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.981713 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.981859 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.982030 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.982121 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.982354 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.982448 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.982613 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.982744 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.982944 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.983037 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.983267 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828060-2-iscsi {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.983368 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.983591 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.983732 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.983895 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.984023 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.984198 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.984339 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.984502 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.984631 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.984802 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.984947 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828060-2-iscsi {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.985122 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.985257 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.985423 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.985513 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.985740 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.985920 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.986480 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.986480 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.986831 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.986831 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.987046 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.987155 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.987256 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.987363 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.987486 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.987623 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.987803 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.987900 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.988117 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.988207 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.988430 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.988509 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.988771 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.988851 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.989090 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.989171 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.989444 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.989560 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828060-2-iscsi {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.989804 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.989894 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.990118 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.990207 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.990448 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.990578 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.990792 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.990906 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.991198 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828060-2-iscsi {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.991295 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.991510 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.991599 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.991829 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.991961 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.992146 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.992229 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.992448 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.992566 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.992785 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.992875 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.993104 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.993187 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.993421 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.993515 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.993740 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.993819 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.994040 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.994123 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.994347 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.994440 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.994671 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.994789 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.994992 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.995085 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.995299 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.995395 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.995603 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.995685 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.995852 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.995977 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.996159 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.996293 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.996478 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.996619 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.996796 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.996931 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.997117 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.997243 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.997368 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.997500 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.997619 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.997811 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.997937 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.998139 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.998617 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.998858 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.998942 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.999189 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.999273 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.999446 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.999529 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.999703 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:57.999830 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.000028 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.000135 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.000354 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.000436 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.000669 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.000759 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.000985 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.001074 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.001297 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.001379 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.001610 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.001702 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.001926 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.002009 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.002229 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.002317 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.002536 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.002627 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.002881 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.002965 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.003197 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.003288 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.003502 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.003586 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.003825 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.003907 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.004137 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.004218 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.004442 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.004626 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.004750 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.004853 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.005095 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.005180 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.005388 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.005470 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.005692 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.005777 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.005999 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.006084 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.006317 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.006404 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.006664 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.006752 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.006973 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.007067 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.007224 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.007314 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.007525 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.007607 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.007828 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.007919 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.008145 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.008228 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.008449 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.008557 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.008759 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.008871 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.009062 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.009149 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.009362 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.009450 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.009664 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.009755 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.009969 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.010051 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.010275 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.010364 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.010580 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.010693 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.010911 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.011000 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.011213 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.011294 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.011516 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.011607 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.011818 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.011901 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.012119 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.012205 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.012432 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.012522 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.012745 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.012829 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.013046 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.013135 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.013349 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.013440 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.013650 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.013731 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.013954 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.014048 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.014273 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.014356 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.014573 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.014743 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.014900 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.014982 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.015220 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.015303 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.015521 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.015600 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.015823 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.015912 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.016138 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.016230 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.016442 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.016533 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.016744 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.016829 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.017060 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.017144 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.017360 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.017449 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.017663 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.017747 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.017980 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.018069 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.018280 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.018367 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.018583 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.018698 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.018911 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.018996 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.019214 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.019298 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.019515 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.019606 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.020053 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.020146 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.020247 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.020326 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.020402 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.020490 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.020799 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.020895 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.021093 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.021175 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.021403 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.021495 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.021711 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.021791 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.022014 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.022094 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.022314 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.022397 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.022617 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.022761 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.022964 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.023049 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.023291 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.023374 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.023606 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.023696 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.023918 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.024001 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.024227 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.024311 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.024549 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:28:58.024665 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.024865 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.024956 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.025177 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.025260 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.025491 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.025581 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.025817 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.025941 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.026127 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.026210 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.026437 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.026518 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.026776 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.026874 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.027097 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.027180 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.027414 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.027497 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.027744 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.027833 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.028058 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.028148 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.028368 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.028449 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.028686 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.028862 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.028996 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.029087 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.029310 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.029401 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.029634 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.029725 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.029951 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.030042 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.030258 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.030338 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.030577 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.030715 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.030921 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.031005 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.031245 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.031328 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.031563 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.031656 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.031891 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.032055 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.032201 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.032349 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.032505 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.032589 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.032812 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.032903 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.033131 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.033222 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.033472 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.033556 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.033780 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.033903 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.034095 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.034178 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.034405 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.034488 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.034732 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.034826 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.035041 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.035138 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.035348 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.035432 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.035656 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.035745 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.036033 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.036183 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.036333 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.036464 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.036651 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.036796 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.037031 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.037205 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.037351 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.037483 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.037652 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.037791 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.037950 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.038107 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.038253 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.038456 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.038575 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.038753 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.038888 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.039012 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.039118 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.039234 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.039340 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.039487 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.039645 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.039804 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.039962 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.040120 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.040287 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.040432 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.040593 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.040740 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.040924 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.041049 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.041228 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.041364 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.041536 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.041678 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.041842 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.042004 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.042149 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.042338 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.042454 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.042675 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.042794 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.043015 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.043098 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.043329 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.043404 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.043648 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.043727 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.043964 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.044054 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.044279 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.044354 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.044592 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.044664 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.044893 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.044964 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.045198 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.045277 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.045509 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.045581 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.045815 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.045925 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.046125 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.046253 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.046432 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.046515 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.046771 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.046871 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.047087 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.047178 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.047392 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.047474 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.047712 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.047808 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.048030 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.048116 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.048331 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.048412 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.048648 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.048737 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.049134 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.049224 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.049311 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.049389 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.049554 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.049648 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.049860 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.049972 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.050164 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.050247 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.050467 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.050558 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.050792 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.050878 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.051099 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.051182 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.051403 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.051488 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.051708 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.051790 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.052075 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.052166 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.052376 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.052499 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.052679 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.052763 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.052998 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.053082 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.053305 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.053391 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.053607 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.053704 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.053911 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.054038 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.054214 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.054308 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.054518 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.054600 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.054864 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.055034 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.055196 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.055281 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.055513 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.055597 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.055825 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.055920 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.056138 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.056229 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.056445 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.056532 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.056761 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.056854 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.057070 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.057152 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.057379 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.057469 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.057790 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.057877 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.058335 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.058437 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.058524 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.058603 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.058741 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.058823 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.058933 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.059007 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.059243 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.059336 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.059566 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.059651 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.059876 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.059959 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.060195 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.060285 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.060500 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.060585 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.060816 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.060904 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.061141 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.061232 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.061462 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.061553 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.061773 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.061855 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.062092 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.062184 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.062401 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.062486 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.062730 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.062807 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.063037 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.063122 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.063348 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.063421 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.063655 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.063737 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.063962 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.064043 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.064280 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.064354 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.064591 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.064663 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.064906 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.064992 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.065214 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.065298 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.065526 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.065759 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.065846 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.066071 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.066145 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.066407 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.066500 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.066720 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.066821 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.067021 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.067106 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.067349 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.067439 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.067735 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.067832 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.068044 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.068128 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.072423 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.072555 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.072555 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.072727 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.072810 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.072888 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.072888 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073037 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073123 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073202 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073285 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073362 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073439 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073515 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073598 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073677 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073760 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073837 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073912 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.073988 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074072 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074158 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074236 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074311 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074385 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074451 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074526 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074597 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074679 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074759 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074837 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.074921 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075000 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075082 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075159 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075159 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075159 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075159 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075446 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075446 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075446 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.075742 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.076018 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.076112 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.076352 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.076452 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.076682 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.076777 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.077019 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.077137 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.077333 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.077428 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.077648 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.077740 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.078008 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.078328 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.078639 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.078980 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.079307 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.079393 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.079623 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.079718 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.080022 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.080366 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.080697 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.081013 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.081333 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.081760 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.082105 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.082438 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.082802 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.083159 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.083317 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.083482 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.083638 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.083806 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.083950 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.084144 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.084294 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.084476 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.084688 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.084828 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.084961 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.085117 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.085245 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.085789 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.085940 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.086065 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.086198 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.086344 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.086483 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.086599 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.086762 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.086901 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.087021 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.087155 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.087275 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.087402 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.087531 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.087775 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.088033 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.088175 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.088324 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.088458 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.088587 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.088720 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.088876 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.089014 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.089147 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.089292 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.089425 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.089568 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.089716 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.089850 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.089965 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.090133 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.090312 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.090439 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.090625 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.090961 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.091105 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.091267 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.091385 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.091580 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.091713 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.091889 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.092019 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.092198 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.092322 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.092500 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.092603 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.092815 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.092945 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.093122 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.093280 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.093428 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.093819 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.094160 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.094481 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.094816 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.095036 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.095398 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.095725 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.096046 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.096364 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.097130 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.098130 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.098265 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.098265 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.098463 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.098539 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.098611 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.098786 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.098970 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.099049 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.099135 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.099213 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.099278 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.099342 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.099416 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.100246 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.100349 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.100349 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.100470 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.100801 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.101479 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.101479 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.101726 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.102036 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.102118 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.102457 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.102539 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.102795 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.102887 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.103169 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.103504 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.103861 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.104193 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.104519 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.104844 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.105168 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.105496 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.105904 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.106241 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.106581 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.106939 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.107270 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.107597 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.107722 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.107917 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.108003 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.108340 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.108463 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.108694 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.108803 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.109024 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.109208 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.109343 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.109429 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.109658 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.109751 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.109971 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.110057 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.110289 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.110381 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.110610 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.110724 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.110944 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.111029 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.111262 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.111345 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.111573 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.111669 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.111886 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.111968 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.112196 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.112278 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.112504 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.112596 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.112812 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.112902 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.113125 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.113208 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.113434 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.113525 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.113738 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.113828 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.114056 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.114138 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.114387 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.114482 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.114726 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.114813 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.115042 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.115172 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.115358 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.115444 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.115665 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.115748 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.115971 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.116054 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.116281 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.116364 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.116601 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.116685 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.116914 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.116998 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.117217 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.117300 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.117529 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.117611 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.117838 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.117926 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.118145 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.118236 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.118452 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.118535 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.118788 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.118888 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.119100 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.119225 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.119401 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.119473 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.119706 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.119801 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.120011 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.120095 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.120313 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.120398 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.120710 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121113 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121113 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121264 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121342 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121417 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121522 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121615 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121824 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.121908 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.122171 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.122263 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.122478 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.122563 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.122823 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.122941 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.123140 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.123557 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.123811 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.123895 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.124124 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.124205 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.126027 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.126124 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.126217 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.126364 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.126452 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.126529 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.126604 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.127443 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.127554 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.127636 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.127720 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.127840 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.127908 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.127982 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128067 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128145 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128220 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128296 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128378 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128463 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128540 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128623 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128700 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128781 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128859 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.128945 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129024 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129106 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129183 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129248 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129311 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129382 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129470 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129554 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129630 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129705 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129780 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.129941 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.130195 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.130320 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.130518 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.130634 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.130872 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.130962 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.131186 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.131278 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.131510 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.131644 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.131821 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.131914 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.132139 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.132226 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.132451 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.132577 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.132763 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.132850 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.133075 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.133167 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.133382 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.133482 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.133708 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.133801 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.134019 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.134123 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.134324 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.134420 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.134635 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.134762 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.134969 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.135084 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.135408 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.135550 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.135636 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.135744 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.135938 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.136028 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.136253 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.136341 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.136650 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.136763 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.136903 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.136989 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.137202 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.137286 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.137515 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.137588 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.137826 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.137909 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.138141 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.138225 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.138443 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.138530 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.138781 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.138883 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.139124 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.139210 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.139443 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.139526 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.139753 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.139835 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.140057 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.140149 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.140362 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.140445 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.140675 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.140765 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.140991 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.141107 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.141289 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.141430 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.141589 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.141749 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.141893 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.142072 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.142219 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.142387 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.142536 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.142730 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.143058 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.143145 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.143287 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.143371 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.143597 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.143689 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.143904 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.143987 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.144317 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.144401 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.144629 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.144721 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.144938 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.145029 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.145261 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.145341 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.145566 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.145666 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.145908 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.145981 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.146213 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.146286 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.146526 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.146601 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.146863 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.146942 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.147175 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.147248 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.147486 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.147564 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.147796 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.147922 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.148115 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.148229 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.148419 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.148531 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.148748 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.148875 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.149071 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.149225 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.149385 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.149579 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.149752 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.150030 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.150176 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.150424 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.150564 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.150826 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.150963 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.151113 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.151309 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.151442 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.151644 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.151799 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.151947 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.152077 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.152257 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.152566 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.152701 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.152849 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.153019 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.153180 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.153356 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.153493 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.153691 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.153843 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.154010 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.154144 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.154333 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.154470 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.154681 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.154843 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.154977 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.155117 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.155281 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.155373 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.155584 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.155687 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.155906 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.155991 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.156218 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.156301 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.156522 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.156653 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.156843 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.156990 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.157149 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.157310 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.157468 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.157640 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.157779 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.157975 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.158094 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.158287 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.158420 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.158599 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.158705 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.158961 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.159099 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.159269 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.159361 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.159578 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.159707 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.159905 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.159988 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.160210 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.160295 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.160528 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.160612 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.160843 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.160926 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.161168 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.161275 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.161556 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.161641 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.161874 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.161971 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.162200 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.162286 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.162501 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.162583 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.162831 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.162932 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.163141 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.163234 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.163446 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.163530 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.163750 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.163843 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.164056 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.164139 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.164364 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.164448 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.164668 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.164759 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.164972 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.165054 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.165271 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.165390 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.165581 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.165666 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.165885 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.166012 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.166207 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.166340 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.166495 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.166638 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.166840 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.166977 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.167112 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.167246 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.167404 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.167536 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.167727 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.167869 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.168034 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.168238 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.168373 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.168569 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.168705 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.168836 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.168965 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.169091 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.169281 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.169393 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.169590 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.169704 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.169911 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.170006 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.170226 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.170310 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.170545 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.170627 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.170883 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.170985 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.171198 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.171310 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.171519 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.171665 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.171825 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.171962 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.172135 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.172261 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.172435 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.172521 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.172750 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.172835 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.173064 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.173147 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.173379 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.173476 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.173682 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.173946 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.174037 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.174277 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.174360 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.174593 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.174724 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.174932 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.175025 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.175246 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.175331 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.175560 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.175656 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.175872 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.175956 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.176186 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.176271 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.176499 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.176594 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.176810 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.176926 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.177160 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.177250 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.177482 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.177567 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.177802 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.177884 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.178120 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.178200 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.178446 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.178520 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.178782 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.178870 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.179100 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.179196 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.179415 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.179497 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.179726 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.179807 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.180043 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.180133 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.180367 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.180458 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.180679 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.180940 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.181025 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.181275 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.181359 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.181593 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.181679 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.181907 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.182000 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.182217 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.182301 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.182532 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.182614 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.182875 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.182986 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.183185 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.183269 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.183494 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.183578 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.183807 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.184084 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.184179 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.184246 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.184425 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.184519 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.184755 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.184839 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.185074 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.185146 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.185389 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.185462 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.185702 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.185787 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.186017 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.186108 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.186332 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.186538 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.186677 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.186879 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.187042 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.187211 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.187368 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.187538 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.187679 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.187860 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.188002 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.188181 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.188324 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.188495 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.188646 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.188822 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.188953 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.189129 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.189267 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.189434 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.189587 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.189744 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.189906 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.190052 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.190222 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.190361 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.190539 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.190711 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.190896 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.191022 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.191219 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.191328 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.191549 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.191640 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.191889 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.191979 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.192219 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.192451 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.192602 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.192865 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.192949 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.193181 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.193267 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.193506 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.193730 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.193814 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.194058 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.194151 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.194401 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.194496 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.194751 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.194843 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.195062 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.195155 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.195367 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.195460 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.195683 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.195769 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.195993 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.196085 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.196300 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.196385 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.196606 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.196691 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.196919 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.197004 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.197227 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.197311 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.197531 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.197615 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.197841 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.197927 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.198143 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.198239 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.198455 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.198577 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.198776 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.198860 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.199075 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.199160 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.199380 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.199630 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.199723 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.199978 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.200060 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.200288 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.200372 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.200593 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.200678 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.200897 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.200982 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.201211 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.201297 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.201516 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.201608 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.201824 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.201908 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.202127 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.202211 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.202436 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.202528 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.202760 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.202859 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.203069 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.203154 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.203372 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.203458 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.203678 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.203760 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.203994 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.204087 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.204309 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.204393 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.204621 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.204767 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.204929 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.205025 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.205233 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.205317 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.205551 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.205633 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.205862 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.205955 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.206169 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.206259 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.206479 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.206563 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.206821 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.207044 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.207132 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.207380 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.207464 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.207704 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.207796 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.208016 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.208131 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.208364 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.208502 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.208672 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.208780 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.208978 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.209119 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.209282 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.209408 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.209599 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.209726 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.209907 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.210034 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.210214 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.210301 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.210519 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.210604 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.210860 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.211000 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.211172 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.211303 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.211489 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.211619 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.211800 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.211953 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.212093 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.212243 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.212396 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.212521 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.212700 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.212840 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.212992 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.213129 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.213312 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.213458 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.213648 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.213782 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.213970 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.214215 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.214354 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.214559 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.214718 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.214910 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.215073 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.215235 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.215370 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.215518 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.215655 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.215803 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.215890 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.216114 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.216261 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.216429 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.216569 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.216759 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.216918 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.217074 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.217210 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.217355 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.217468 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.217676 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.217822 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.217994 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.218135 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.218314 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.218451 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.218632 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.218886 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.219023 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.219178 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.219370 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.219554 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.219701 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.219849 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.219952 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.220039 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.220183 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.220318 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.220505 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.220647 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.220830 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.221015 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.221160 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.221287 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.221487 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.221626 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.222107 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.222256 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.222391 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.222522 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.222696 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.222818 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.222954 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.223073 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.223190 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.223330 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.223441 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.223549 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.223665 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.223811 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.224051 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.224188 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.224375 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.224500 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.224681 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.224804 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.225001 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.225117 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.225311 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.225434 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.225628 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.225711 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.225992 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.226085 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.226263 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.226348 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.226571 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.226673 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.226926 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.227017 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.227237 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.227340 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.227545 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.227630 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.227857 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.227982 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.228212 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.228308 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.228471 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.228565 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.228781 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.228921 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.229108 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.229194 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.229436 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.229533 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.229743 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.229834 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.230050 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.230133 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.230365 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.230501 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.230713 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.230805 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.231028 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.231112 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.231340 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.231434 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.231669 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.231758 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.231979 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.232081 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.232295 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.232387 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.232603 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.232697 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.232911 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.232994 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.233227 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.233319 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.233543 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.233628 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.233855 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.233947 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.234181 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.234277 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.234493 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.234577 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.234839 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.234940 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.235157 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.235241 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.235474 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.235558 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.235791 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.235887 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.236107 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.236190 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.236428 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.236511 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.236740 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.236833 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.237049 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.237146 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.237295 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 03:28:58.237371 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.237685 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.238012 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.238335 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.238690 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.239025 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.239331 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.239683 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.240002 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.240320 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.240643 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.240966 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.241298 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.241632 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.241969 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.242303 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.242674 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.242999 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.243348 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.243684 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.244005 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.244321 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.244631 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:28:58.244880 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 03:28:58.266063 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG oslo_db.sqlalchemy.engines [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:28:58.268199 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_db.sqlalchemy.engines [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:28:58.331847 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.context [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e5db6ec-3f2c-49f5-9851-3e8c38c287f1(cell1) {{(pid=101994) load_cells /opt/stack/nova/nova/context.py:464}} Feb 10 03:28:58.335837 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.context [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e5db6ec-3f2c-49f5-9851-3e8c38c287f1(cell1) {{(pid=101995) load_cells /opt/stack/nova/nova/context.py:464}} Feb 10 03:28:58.336159 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:28:58.337772 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:28:58.338584 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:28:58.340041 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG oslo_concurrency.lockutils [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:28:58.340552 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:28:58.341614 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG oslo_concurrency.lockutils [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:28:58.342417 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG oslo_concurrency.lockutils [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:28:58.344358 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG oslo_concurrency.lockutils [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:28:58.353103 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_db.sqlalchemy.engines [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:28:58.356809 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_db.sqlalchemy.engines [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:28:58.359548 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG oslo_db.sqlalchemy.engines [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:28:58.362195 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG oslo_db.sqlalchemy.engines [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:28:58.510238 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_db.sqlalchemy.engines [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:28:58.517965 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG oslo_db.sqlalchemy.engines [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:28:58.850783 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: WARNING keystonemiddleware.auth_token [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 10 03:28:58.855287 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: WARNING keystonemiddleware.auth_token [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 10 03:28:58.859260 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: WARNING keystonemiddleware.auth_token [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 10 03:28:58.863064 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: WARNING keystonemiddleware.auth_token [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 10 03:28:59.204031 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: WARNING keystonemiddleware.auth_token [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 10 03:28:59.204812 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: WARNING keystonemiddleware.auth_token [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 10 03:28:59.209382 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: WARNING keystonemiddleware.auth_token [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 10 03:28:59.210205 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: WARNING keystonemiddleware.auth_token [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 10 03:28:59.214508 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e8302cc9c0 pid: 101994 (default app) Feb 10 03:28:59.215343 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e8302cc9c0 pid: 101995 (default app) Feb 10 03:28:59.216603 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:28:59.217757 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-05a38cbb-d4a4-4990-a679-09151cbac84e None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Feb 10 03:28:59.218167 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Thu Feb 10 03:28:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:25.699438 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:25.701511 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002923 Feb 10 03:30:25.703610 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:25 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:26.310631 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-22a8ba89-d329-458c-b12e-f4b525d06ff3 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:26.347209 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-22a8ba89-d329-458c-b12e-f4b525d06ff3 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.636994 Feb 10 03:30:26.348150 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Feb 10 03:30:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:29.065469 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:29.067403 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-57be9900-6f4b-4b14-a4c3-9f6ce50b80e4 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002401 Feb 10 03:30:29.068333 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 2/4] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:29.179165 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-ddcbfe35-992c-4707-a577-fcd8f2a8a121 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "ram": 256}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:29.213673 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:30:29.213673 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: warnings.warn(msg) Feb 10 03:30:29.268469 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-ddcbfe35-992c-4707-a577-fcd8f2a8a121 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.189646 Feb 10 03:30:29.270196 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 3/5] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:30:29.717678 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-5c52d548-09ce-412b-ba58-f48020a6617c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:29.720582 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:30:29.720582 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: warnings.warn(msg) Feb 10 03:30:29.825216 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-5c52d548-09ce-412b-ba58-f48020a6617c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.541161 Feb 10 03:30:29.826193 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 3/6] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Feb 10 03:30:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:32.433786 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-ddcbfe35-992c-4707-a577-fcd8f2a8a121 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:32.435956 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-ddcbfe35-992c-4707-a577-fcd8f2a8a121 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002391 Feb 10 03:30:32.437141 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 4/7] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:30:32.601773 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-6d0c4906-0ea6-419f-a597-b2949661ff48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:32.632237 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:30:32.632237 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: warnings.warn(msg) Feb 10 03:30:32.662414 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-6d0c4906-0ea6-419f-a597-b2949661ff48 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.218919 Feb 10 03:30:32.663219 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 4/8] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:30:32.687925 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-7f3ae789-eb84-4937-b595-b1762f2fe15e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:32.690726 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:30:32.690726 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: warnings.warn(msg) Feb 10 03:30:32.746014 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-7f3ae789-eb84-4937-b595-b1762f2fe15e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068463 Feb 10 03:30:32.754848 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 5/9] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Feb 10 03:30:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:36.440004 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-6d0c4906-0ea6-419f-a597-b2949661ff48 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:36.441128 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-6d0c4906-0ea6-419f-a597-b2949661ff48 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Feb 10 03:30:36.441777 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:36.545526 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-e13e45f5-b338-4e34-8334-8942c5ca8f56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:36.573167 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-e13e45f5-b338-4e34-8334-8942c5ca8f56 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.123928 Feb 10 03:30:36.579935 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 6/11] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:30:36.591381 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-ba5c290d-69fc-4eb2-96fd-0e5076c7f31d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:36.640674 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-ba5c290d-69fc-4eb2-96fd-0e5076c7f31d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056781 Feb 10 03:30:36.641347 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 6/12] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Feb 10 03:30:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:39.431661 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-e13e45f5-b338-4e34-8334-8942c5ca8f56 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:39.432673 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-e13e45f5-b338-4e34-8334-8942c5ca8f56 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Feb 10 03:30:39.433790 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 7/13] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:39.526814 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-8ff0aeda-0e2f-4ab3-9340-29cbba6f61c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:39.592746 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-8ff0aeda-0e2f-4ab3-9340-29cbba6f61c7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149158 Feb 10 03:30:39.593840 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 7/14] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:30:39.607137 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-c778f6d5-a24b-4f19-831c-ed54330a1dca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:39.635200 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-c778f6d5-a24b-4f19-831c-ed54330a1dca admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031898 Feb 10 03:30:39.635793 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 8/15] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Feb 10 03:30:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:30:42.330905 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-8ff0aeda-0e2f-4ab3-9340-29cbba6f61c7 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:42.331907 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-8ff0aeda-0e2f-4ab3-9340-29cbba6f61c7 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Feb 10 03:30:42.332480 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 8/16] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:30:42.428378 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-63f914f4-28a8-4b6b-a9f5-734928c4da57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "ram": 4096, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:42.453137 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-63f914f4-28a8-4b6b-a9f5-734928c4da57 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.114116 Feb 10 03:30:42.454028 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 9/17] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:30:42.471182 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-39bf55de-182f-482f-a6c4-450ca0a81969 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:42.513314 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-39bf55de-182f-482f-a6c4-450ca0a81969 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048889 Feb 10 03:30:42.514439 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 9/18] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Feb 10 03:30:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:45.218139 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-63f914f4-28a8-4b6b-a9f5-734928c4da57 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:45.219201 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-63f914f4-28a8-4b6b-a9f5-734928c4da57 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Feb 10 03:30:45.219958 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 10/19] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:45.289260 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-bf61c403-7e57-4fc9-a0ad-b5d6d4ed252b admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:45.316139 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-bf61c403-7e57-4fc9-a0ad-b5d6d4ed252b admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089474 Feb 10 03:30:45.316896 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 10/20] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Feb 10 03:30:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:30:47.809232 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-63f914f4-28a8-4b6b-a9f5-734928c4da57 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:47.810292 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-63f914f4-28a8-4b6b-a9f5-734928c4da57 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Feb 10 03:30:47.810730 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 11/21] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:47.874107 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-00716384-ffb3-4781-acb1-b42065bf2e41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "swap": 0, "name": "m1.tiny"}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:47.897445 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-00716384-ffb3-4781-acb1-b42065bf2e41 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080209 Feb 10 03:30:47.898020 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 11/22] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:30:47.911578 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-c6bc7c2a-78cf-4aa2-af07-57e72c75cd1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:47.938312 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-c6bc7c2a-78cf-4aa2-af07-57e72c75cd1d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030319 Feb 10 03:30:47.938771 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 12/23] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Feb 10 03:30:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:50.436374 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-00716384-ffb3-4781-acb1-b42065bf2e41 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:50.437500 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-00716384-ffb3-4781-acb1-b42065bf2e41 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Feb 10 03:30:50.438010 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:50.501564 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-dee57652-e465-4b04-9736-bc1e1aa23d57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:50.525331 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-dee57652-e465-4b04-9736-bc1e1aa23d57 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080937 Feb 10 03:30:50.526211 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 13/25] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:30:50.539136 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-042318bf-e05d-40b3-b48d-0071c411e759 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:50.567168 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-042318bf-e05d-40b3-b48d-0071c411e759 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032362 Feb 10 03:30:50.567799 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 13/26] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Feb 10 03:30:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:53.042638 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-dee57652-e465-4b04-9736-bc1e1aa23d57 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:53.044143 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-dee57652-e465-4b04-9736-bc1e1aa23d57 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002533 Feb 10 03:30:53.044669 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 14/27] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:53.110223 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-5d9f0b62-1b60-449b-b806-76c67c992e71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "disk": 40, "vcpus": 2}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:53.148540 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-5d9f0b62-1b60-449b-b806-76c67c992e71 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.095400 Feb 10 03:30:53.150154 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 14/28] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:30:53.162887 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-1f564869-22a6-4d51-a419-31275127a0aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:53.188434 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-1f564869-22a6-4d51-a419-31275127a0aa admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029341 Feb 10 03:30:53.189044 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 15/29] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Feb 10 03:30:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:55.604312 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-5d9f0b62-1b60-449b-b806-76c67c992e71 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:55.606127 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-5d9f0b62-1b60-449b-b806-76c67c992e71 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002764 Feb 10 03:30:55.606863 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 15/30] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:55 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:55.673029 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-fb434e5a-1b41-42cf-9e9c-083a44e7def7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:55.700184 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-fb434e5a-1b41-42cf-9e9c-083a44e7def7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082847 Feb 10 03:30:55.701452 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 16/31] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:30:55.714960 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-e73eecc6-1b5d-46f2-984e-771ea2b3bdea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:55.749120 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-e73eecc6-1b5d-46f2-984e-771ea2b3bdea admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037422 Feb 10 03:30:55.750205 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 16/32] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Feb 10 03:30:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:30:58.195821 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-fb434e5a-1b41-42cf-9e9c-083a44e7def7 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:30:58.197029 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-fb434e5a-1b41-42cf-9e9c-083a44e7def7 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Feb 10 03:30:58.197361 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 17/33] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:30:58.258963 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-30cff5b0-51dc-4a7d-8f2a-a506ffdb9d1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "swap": 0, "disk": 160, "name": "m1.xlarge"}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:58.278801 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-30cff5b0-51dc-4a7d-8f2a-a506ffdb9d1d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075095 Feb 10 03:30:58.279524 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 17/34] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Feb 10 03:30:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:30:58.291640 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-c4f66df2-fe76-42f9-b5c3-5a4ad421746a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:30:58.315931 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-c4f66df2-fe76-42f9-b5c3-5a4ad421746a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027820 Feb 10 03:30:58.316533 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 18/35] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Feb 10 03:30:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:31:23.394628 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-30cff5b0-51dc-4a7d-8f2a-a506ffdb9d1d admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:23.395660 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-30cff5b0-51dc-4a7d-8f2a-a506ffdb9d1d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Feb 10 03:31:23.396277 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 18/36] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:23.458513 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-35c0907c-3f90-47ba-8f36-2c6fd136d308 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:23.475571 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-35c0907c-3f90-47ba-8f36-2c6fd136d308 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071782 Feb 10 03:31:23.476127 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Feb 10 03:31:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:31:24.860719 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-30cff5b0-51dc-4a7d-8f2a-a506ffdb9d1d admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:24.861894 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-30cff5b0-51dc-4a7d-8f2a-a506ffdb9d1d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Feb 10 03:31:24.862121 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 19/38] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:25.056719 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-3b06eb51-bbbd-4040-a0b6-ed8322aa4b7d admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:25.062607 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.wsgi [None req-3b06eb51-bbbd-4040-a0b6-ed8322aa4b7d admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 10 03:31:25.063221 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-3b06eb51-bbbd-4040-a0b6-ed8322aa4b7d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:31:25.064031 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-3b06eb51-bbbd-4040-a0b6-ed8322aa4b7d admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060479 Feb 10 03:31:25.064545 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 20/39] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Feb 10 03:31:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:25.074132 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-eb488a4e-ecb0-4f27-9430-7ccb07305162 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:25.095901 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-eb488a4e-ecb0-4f27-9430-7ccb07305162 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025308 Feb 10 03:31:25.096501 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 20/40] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Feb 10 03:31:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:31:25.107093 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-93e899f9-5378-4644-adc5-15b9cb0250f4 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:25.129167 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-93e899f9-5378-4644-adc5-15b9cb0250f4 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025521 Feb 10 03:31:25.129715 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 21/41] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Feb 10 03:31:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:31:25.139552 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-e46ff04b-a11f-407f-a600-6f675f0c6872 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:25.145840 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.wsgi [None req-e46ff04b-a11f-407f-a600-6f675f0c6872 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 10 03:31:25.146426 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-e46ff04b-a11f-407f-a600-6f675f0c6872 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:31:25.147282 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-e46ff04b-a11f-407f-a600-6f675f0c6872 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011477 Feb 10 03:31:25.147797 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Feb 10 03:31:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 10 03:31:26.429699 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-93e899f9-5378-4644-adc5-15b9cb0250f4 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:26.430799 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-93e899f9-5378-4644-adc5-15b9cb0250f4 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Feb 10 03:31:26.431181 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 22/43] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:26.622855 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-ba3199e3-0fbe-4532-8b8f-4dd09034ad25 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:26.629202 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.wsgi [None req-ba3199e3-0fbe-4532-8b8f-4dd09034ad25 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 10 03:31:26.629686 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-ba3199e3-0fbe-4532-8b8f-4dd09034ad25 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:31:26.630491 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-ba3199e3-0fbe-4532-8b8f-4dd09034ad25 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061338 Feb 10 03:31:26.631072 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Feb 10 03:31:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:26.640943 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-4e45528a-1d46-4474-a66c-cfa995779ab2 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:26.656056 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-4e45528a-1d46-4474-a66c-cfa995779ab2 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018592 Feb 10 03:31:26.656680 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Feb 10 03:31:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:31:26.666607 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-754b186c-3e7d-4430-ad76-07b6cdfb644f admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:26.681971 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-754b186c-3e7d-4430-ad76-07b6cdfb644f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018808 Feb 10 03:31:26.682540 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Feb 10 03:31:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:31:26.692329 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-cd4c5f72-84a5-417b-9a7f-89e7d5e8d487 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:26.698284 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.wsgi [None req-cd4c5f72-84a5-417b-9a7f-89e7d5e8d487 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 10 03:31:26.698951 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-cd4c5f72-84a5-417b-9a7f-89e7d5e8d487 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:31:26.699745 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-cd4c5f72-84a5-417b-9a7f-89e7d5e8d487 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011059 Feb 10 03:31:26.700248 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 24/47] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Feb 10 03:31:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:27.976361 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-754b186c-3e7d-4430-ad76-07b6cdfb644f admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:27.977391 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-754b186c-3e7d-4430-ad76-07b6cdfb644f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Feb 10 03:31:27.977942 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 24/48] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:28.170875 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-caea4bd2-31c3-4214-b973-db2998453467 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:28.176323 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.wsgi [None req-caea4bd2-31c3-4214-b973-db2998453467 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 10 03:31:28.176893 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-caea4bd2-31c3-4214-b973-db2998453467 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:31:28.177698 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-caea4bd2-31c3-4214-b973-db2998453467 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061921 Feb 10 03:31:28.178251 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 25/49] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Feb 10 03:31:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:28.188084 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-f150d863-e675-4d91-a377-007b683dcf25 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:28.203475 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-f150d863-e675-4d91-a377-007b683dcf25 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019112 Feb 10 03:31:28.204019 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 25/50] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Feb 10 03:31:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:31:28.214468 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:28.228045 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017513 Feb 10 03:31:28.228770 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 26/51] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Feb 10 03:31:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:31:28.238596 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-d8f5c624-6ef2-4ee4-968a-d2b922795a82 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:28.244267 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.wsgi [None req-d8f5c624-6ef2-4ee4-968a-d2b922795a82 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 10 03:31:28.244842 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-d8f5c624-6ef2-4ee4-968a-d2b922795a82 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:31:28.245682 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-d8f5c624-6ef2-4ee4-968a-d2b922795a82 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010729 Feb 10 03:31:28.246195 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 26/52] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Feb 10 03:31:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 10 03:31:29.524122 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:29.525279 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001845 Feb 10 03:31:29.525779 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:29.718434 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-6dfd0be8-1e99-44db-9178-3102d577060a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:31:29.738472 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-6dfd0be8-1e99-44db-9178-3102d577060a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074470 Feb 10 03:31:29.739053 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 27/54] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Feb 10 03:31:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:31:31.031882 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:31.032900 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Feb 10 03:31:31.033304 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 28/55] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:31.225379 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-6a75275e-c52e-4fd5-9d6f-fa0454da1f9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:31:31.245427 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-6a75275e-c52e-4fd5-9d6f-fa0454da1f9c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074925 Feb 10 03:31:31.245921 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 28/56] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Feb 10 03:31:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:31:32.526290 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:32.527378 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Feb 10 03:31:32.527776 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 29/57] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:32.718538 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-6b63b91b-4d1b-4274-b404-e81386698c63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:31:32.738715 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-6b63b91b-4d1b-4274-b404-e81386698c63 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073723 Feb 10 03:31:32.739211 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 29/58] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Feb 10 03:31:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:31:34.031302 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:34.032317 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Feb 10 03:31:34.032711 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 30/59] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:34.246933 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-5c30cf87-a735-41fa-bdc8-9b35f0351c83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:31:34.266073 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-5c30cf87-a735-41fa-bdc8-9b35f0351c83 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084478 Feb 10 03:31:34.266630 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 30/60] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Feb 10 03:31:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:31:35.543053 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:35.544053 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Feb 10 03:31:35.544453 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 31/61] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:31:35.734521 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-64f304de-8040-409c-ac66-39231f3866ab admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:31:35.754164 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-64f304de-8040-409c-ac66-39231f3866ab admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071839 Feb 10 03:31:35.754624 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 31/62] 10.222.0.32 () {60 vars in 1202 bytes} [Thu Feb 10 03:31:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:32:21.375897 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:32:21.376809 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-4065139a-2794-4dde-b6df-0fe94d63ffc1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Feb 10 03:32:21.377208 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 930 bytes} [Thu Feb 10 03:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:32:21.438976 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-dd060ca5-6e4f-4c53-bca7-436e1193e947 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:32:21.458082 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-dd060ca5-6e4f-4c53-bca7-436e1193e947 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074692 Feb 10 03:32:21.458628 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 32/64] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Feb 10 03:32:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:32:21.480843 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-a64df22a-ba2c-4ee1-9a8d-2998def5fd77 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:32:21.488863 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-a64df22a-ba2c-4ee1-9a8d-2998def5fd77 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011686 Feb 10 03:32:21.489407 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 33/65] 10.222.0.32 () {60 vars in 1282 bytes} [Thu Feb 10 03:32:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:32:21.501300 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-14f6a4e4-a810-4938-939b-34fd9dfc3bad admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:32:21.509258 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-14f6a4e4-a810-4938-939b-34fd9dfc3bad admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012014 Feb 10 03:32:21.510371 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 33/66] 10.222.0.32 () {60 vars in 1285 bytes} [Thu Feb 10 03:32:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:32:21.521732 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-95048e87-7c30-4037-b581-29a54ca58ce9 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:32:21.529667 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-95048e87-7c30-4037-b581-29a54ca58ce9 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011520 Feb 10 03:32:21.530194 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 34/67] 10.222.0.32 () {60 vars in 1285 bytes} [Thu Feb 10 03:32:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:32:21.541653 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:32:21.549463 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011411 Feb 10 03:32:21.549985 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 34/68] 10.222.0.32 () {60 vars in 1282 bytes} [Thu Feb 10 03:32:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:33:47.476984 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-39265339-89ce-4a57-b6bf-ab9a0a6d550b tempest-verify_tempest_config-793312660 tempest-verify_tempest_config-793312660-project] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:33:47.478984 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-39265339-89ce-4a57-b6bf-ab9a0a6d550b tempest-verify_tempest_config-793312660 tempest-verify_tempest_config-793312660-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.110402 Feb 10 03:33:47.479531 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 35/69] 10.222.0.32 () {58 vars in 1133 bytes} [Thu Feb 10 03:33:47 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:35:15.035686 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:35:15.036702 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Feb 10 03:35:15.037098 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 35/70] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:35:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:35:15.307464 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-ccad0fed-67ea-4dbc-8634-f31b68533325 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:35:15.308668 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:35:15.308668 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: warnings.warn(msg) Feb 10 03:35:15.310219 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-ccad0fed-67ea-4dbc-8634-f31b68533325 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:35:15.310675 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-ccad0fed-67ea-4dbc-8634-f31b68533325 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:35:15.311481 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-ccad0fed-67ea-4dbc-8634-f31b68533325 admin admin] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:35:15.311907 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-ccad0fed-67ea-4dbc-8634-f31b68533325 admin admin] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:35:15.346319 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-ccad0fed-67ea-4dbc-8634-f31b68533325 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.169979 Feb 10 03:35:15.346928 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 36/71] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Feb 10 03:35:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:35:16.634625 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:35:16.635649 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Feb 10 03:35:16.636098 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 36/72] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:35:16.839328 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-5c7eb1a6-9b36-4f33-861b-ec2f0917f447 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:35:16.840911 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:35:16.840911 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: warnings.warn(msg) Feb 10 03:35:16.842874 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-5c7eb1a6-9b36-4f33-861b-ec2f0917f447 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:35:16.843373 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-5c7eb1a6-9b36-4f33-861b-ec2f0917f447 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:35:16.844530 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-5c7eb1a6-9b36-4f33-861b-ec2f0917f447 admin admin] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:35:16.845139 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-5c7eb1a6-9b36-4f33-861b-ec2f0917f447 admin admin] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:35:16.867458 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-5c7eb1a6-9b36-4f33-861b-ec2f0917f447 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088958 Feb 10 03:35:16.868038 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 37/73] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Feb 10 03:35:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:35:28.624113 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:35:28.625100 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Feb 10 03:35:28.625635 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 37/74] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:35:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:35:28.842063 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-33ba1038-c724-4a91-a88a-b1ce874fbeb1 admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:35:28.843294 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:35:28.843294 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: warnings.warn(msg) Feb 10 03:35:28.844858 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-33ba1038-c724-4a91-a88a-b1ce874fbeb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:35:28.845292 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-33ba1038-c724-4a91-a88a-b1ce874fbeb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:35:28.846074 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-33ba1038-c724-4a91-a88a-b1ce874fbeb1 admin admin] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:35:28.846499 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-33ba1038-c724-4a91-a88a-b1ce874fbeb1 admin admin] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:35:28.870267 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-33ba1038-c724-4a91-a88a-b1ce874fbeb1 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.094483 Feb 10 03:35:28.870837 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 38/75] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Feb 10 03:35:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:35:30.158299 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: DEBUG nova.api.openstack.wsgi [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] Calling method '>' {{(pid=101995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:35:30.159510 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: INFO nova.api.openstack.requestlog [None req-acadb721-8f91-47be-8ac6-97ae24faaed9 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Feb 10 03:35:30.159903 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: [pid: 101995|app: 0|req: 38/76] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Feb 10 03:35:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:35:30.356072 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG nova.api.openstack.wsgi [None req-f570e865-2f3a-41b6-866d-c9456df9332d admin admin] Calling method '>' {{(pid=101994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:35:30.357285 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:35:30.357285 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: warnings.warn(msg) Feb 10 03:35:30.358900 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-f570e865-2f3a-41b6-866d-c9456df9332d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:35:30.359337 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-f570e865-2f3a-41b6-866d-c9456df9332d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:35:30.360186 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-f570e865-2f3a-41b6-866d-c9456df9332d admin admin] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:35:30.360538 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: DEBUG oslo_concurrency.lockutils [None req-f570e865-2f3a-41b6-866d-c9456df9332d admin admin] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:35:30.382868 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: INFO nova.api.openstack.requestlog [None req-f570e865-2f3a-41b6-866d-c9456df9332d admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083399 Feb 10 03:35:30.383426 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: [pid: 101994|app: 0|req: 39/77] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Feb 10 03:35:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:36:25.652289 dv-cinder-828060-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 10 03:36:25.652920 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: Thu Feb 10 03:36:25 2022 - graceful shutdown triggered... Feb 10 03:36:25.653390 dv-cinder-828060-2-iscsi devstack@n-api.service[101994]: Gracefully killing worker 1 (pid: 101994)... Feb 10 03:36:25.653783 dv-cinder-828060-2-iscsi devstack@n-api.service[101995]: Gracefully killing worker 2 (pid: 101995)... Feb 10 03:36:26.653967 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: worker 1 buried after 1 seconds Feb 10 03:36:26.653967 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: worker 2 buried after 1 seconds Feb 10 03:36:26.653967 dv-cinder-828060-2-iscsi devstack@n-api.service[101991]: goodbye to uWSGI. Feb 10 03:36:26.655905 dv-cinder-828060-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 10 03:36:26.656472 dv-cinder-828060-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 10 03:36:26.659390 dv-cinder-828060-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 10 03:36:26.674433 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Feb 10 03:36:26 2022] *** Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: nodename: dv-cinder-828060-2-iscsi Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: machine: x86_64 Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: clock source: unix Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: pcre jit disabled Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: detected number of CPU cores: 4 Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: current working directory: / Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: detected binary path: /usr/bin/uwsgi-core Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: your processes number limit is 47680 Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: your memory page size is 4096 bytes Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: detected max file descriptor number: 2048 Feb 10 03:36:26.677642 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: lock engine: pthread robust mutexes Feb 10 03:36:26.678709 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: thunder lock: enabled Feb 10 03:36:26.678709 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 10 03:36:26.678709 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 10 03:36:26.725505 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: Python main interpreter initialized at 0x56471b9ea9c0 Feb 10 03:36:26.725505 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: python threads support enabled Feb 10 03:36:26.725505 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: your server socket listen backlog is limited to 100 connections Feb 10 03:36:26.725505 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: your mercy for graceful operations on workers is 90 seconds Feb 10 03:36:26.725956 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: mapped 403077 bytes (393 KB) for 2 cores Feb 10 03:36:26.725956 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: *** Operational MODE: preforking *** Feb 10 03:36:26.726220 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: *** uWSGI is running in multiple interpreter mode *** Feb 10 03:36:26.726220 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: spawned uWSGI master process (pid: 127930) Feb 10 03:36:26.726397 dv-cinder-828060-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 10 03:36:26.727112 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: spawned uWSGI worker 1 (pid: 127951, cores: 1) Feb 10 03:36:26.727420 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: spawned uWSGI worker 2 (pid: 127952, cores: 1) Feb 10 03:36:26.727604 dv-cinder-828060-2-iscsi devstack@n-api.service[127930]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 10 03:36:28.689970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:36:28.689970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: from cryptography.utils import int_from_bytes Feb 10 03:36:28.690703 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:36:28.690703 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: from cryptography.utils import int_from_bytes Feb 10 03:36:28.691308 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:36:28.691308 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: from cryptography.utils import int_from_bytes Feb 10 03:36:28.691853 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 10 03:36:28.691853 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: from cryptography.utils import int_from_bytes Feb 10 03:36:31.095114 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 03:36:31.095823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 03:36:31.095823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 03:36:31.096181 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 10 03:36:31.096571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 03:36:31.096660 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 10 03:36:31.096741 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 03:36:31.096826 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.096901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 10 03:36:31.097121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.097285 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 10 03:36:31.097474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.097576 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 10 03:36:31.097765 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.097872 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.098118 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.098271 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.098448 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.098558 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.098750 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.098862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.099064 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.099178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.099394 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.099493 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.099658 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.099784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.099967 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.100127 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.100291 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828060-2-iscsi {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.100468 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.100650 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.100824 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.100997 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.101165 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.101318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.101501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828060-2-iscsi {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.101656 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.101807 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.101962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.102113 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.102263 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.102405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.102706 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.102950 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.102950 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.103282 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.103466 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.103621 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.104003 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.104400 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.104638 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.104855 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.105076 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.105283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.105505 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.105718 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.105924 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.106154 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.106360 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107154 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107421 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107499 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107572 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107720 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107806 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107879 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.107949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108020 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828060-2-iscsi {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108091 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828060-2-iscsi {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108176 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108249 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108319 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108482 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108738 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.108867 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.109066 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.109188 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.109386 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.109497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.109697 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.109802 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.110009 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.110118 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.110322 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.110440 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.110625 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.110757 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.110976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.111085 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.111297 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.111421 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.111617 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.111736 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.111912 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.112108 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.112290 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.112492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.112638 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.112826 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.112981 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.113126 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.113285 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.113420 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.113539 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.113688 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.113688 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.113925 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.113925 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.114150 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.114259 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.114409 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.114566 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.114696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.114836 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.114948 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.115147 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.115321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.115492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.115655 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.115655 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.115953 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.116098 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.116250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.116404 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.116549 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.116691 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.116865 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.117017 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.117185 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.117343 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.117487 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.117631 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.117779 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.117923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.118105 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.118265 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.118409 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.118583 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.118765 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.118917 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.119070 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.119239 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.119383 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.119533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.119685 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.119841 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.119993 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.120144 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.120301 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.120452 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.120595 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.121238 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.121407 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.123541 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.123711 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.123861 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.124016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.124163 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.124318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.124472 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.124623 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.124767 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.124920 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.125063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.125222 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.125377 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.125532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.125676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.125830 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.125985 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.126136 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.126290 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.126440 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.126590 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.126775 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.126930 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.127074 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.127254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.127423 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.127587 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.127747 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.127898 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.128091 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.128251 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.128394 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.128549 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.128711 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.128855 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.129005 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.129150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.129299 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.129451 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.129687 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.129833 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.129975 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.130118 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.130266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.130416 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.130567 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.130749 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.130905 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.131049 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.131191 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.131342 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.131484 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.131655 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.132255 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.132418 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.132564 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.132736 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.133408 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.133809 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.133963 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.134109 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.134252 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.134406 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.134558 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.134769 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.134930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.135095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.135256 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.135411 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.135563 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.135716 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.135874 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.136025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.136177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.136328 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.136328 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.136616 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.136772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.136915 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.137070 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.137215 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.137365 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.137508 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.137658 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.137811 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.137963 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.138113 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.138255 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.138405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.138549 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.138735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.138894 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.139046 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.139190 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.139339 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.139490 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.139643 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.139797 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.139939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.140095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.140239 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.140381 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.140673 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.140848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.140994 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.141145 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.141297 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.141453 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.141610 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.141763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.141906 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.142049 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.142192 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.142349 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.142499 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.142644 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.142836 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.143467 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.143630 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.144004 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.144163 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.144317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.144468 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.144611 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.144761 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.144920 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.145064 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 10 03:36:31.145228 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.145384 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.145537 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.145689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.145853 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.146008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.146160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.146303 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.146446 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.146611 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.146794 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.146938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.147092 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.147256 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.147409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.147565 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.147716 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.147868 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.148021 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.148172 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.148315 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.148470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.148623 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.148766 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.148909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.149052 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.149219 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.149404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.149548 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.149691 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.149834 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.149991 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.150149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.150301 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.150458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.150609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.150865 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.151126 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.151363 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.151530 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.151682 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.151826 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.151977 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.152128 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.152271 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.152421 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.152576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.152730 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.152873 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.153016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.153631 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.153996 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.154265 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.154426 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.154571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.154770 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.154918 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.155076 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.155225 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.155369 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.155511 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.155663 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.155816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.155967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.156129 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.156273 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.156417 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.156566 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.156718 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.156868 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.157019 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.157168 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.157318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.157471 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.157628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.157773 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.157924 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.158077 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.158220 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.158361 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.158514 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.158684 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.158834 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.158977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.159131 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.159283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.159427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.159427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.159705 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.159855 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.160017 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.160182 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.160940 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.161098 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.161249 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.161395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.161538 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.161696 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.161847 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.161999 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.162141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.162285 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.162437 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.163740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.163915 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.164195 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.164457 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.164609 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.164754 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.164959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.165116 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.165277 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.165421 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.165573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.165727 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.165880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.166023 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.166176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.166319 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.166462 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.166612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.166787 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.167418 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.167593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.167739 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.168159 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.168331 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.168486 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.168645 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.168798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.168951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.169095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.169245 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.169389 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.169540 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.169692 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.169843 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.169998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.170142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.170300 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.170453 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.170599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.170789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.171041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.171197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.171342 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.171498 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.171644 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.171786 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.171937 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.172081 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.172234 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.172389 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.172543 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.172695 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.172840 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.172990 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.173149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.173293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.173941 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.174231 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.174387 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.174685 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.174854 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.175006 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.175165 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.175165 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.175439 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.175580 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.175732 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.175923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.176071 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.176214 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.176357 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.176509 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.176668 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.176812 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.176966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.177109 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.177259 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.177412 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.177639 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.177784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.177926 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.178074 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.178222 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.178385 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.178530 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.178710 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.178870 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.179050 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.179184 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.179329 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.179473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.179568 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.179743 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.179840 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.179934 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180029 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180115 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180198 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180280 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180364 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180459 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180582 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180668 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180752 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.180938 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181195 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181292 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181463 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181555 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181649 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181735 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181825 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.181998 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182091 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182182 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182276 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182453 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182536 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182632 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182874 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.182957 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.183053 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.183139 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.183306 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.183393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.183475 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.183647 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.183976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184067 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184162 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184351 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184435 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184519 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184611 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184722 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184900 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.184989 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185073 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185170 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185256 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185346 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185523 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185614 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185712 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185804 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185889 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.185972 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186054 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186137 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186233 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186319 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186403 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186500 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186586 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186801 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186801 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186986 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.186986 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187147 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187147 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187399 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187491 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187750 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187840 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.187932 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188098 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188180 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188270 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188460 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188636 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188719 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188903 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.188988 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189069 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189159 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189242 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189333 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189429 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189515 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189597 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189679 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189767 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189859 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.189951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190135 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190221 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190381 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190573 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190685 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190785 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190869 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.190961 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191058 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191144 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191227 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191371 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191469 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191567 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191661 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191746 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.191922 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192005 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192096 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192345 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192431 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192512 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192594 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192775 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192864 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.192956 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193131 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193224 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193401 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193490 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193573 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193795 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.193903 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194233 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194319 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194415 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194584 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194680 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194884 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.194983 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195117 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195217 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195667 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195759 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195844 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.195933 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.196016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.196118 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.196238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.196380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.196472 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.196694 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.196787 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.197007 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.197111 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.197325 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.197419 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.197630 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.197720 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.197941 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.198042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.198249 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.198339 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.198552 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.198701 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.198888 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.198971 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.199202 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.199303 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.199515 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.199789 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.199894 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.200122 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.200218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.200435 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.200524 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.200755 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.201014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.201113 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.201352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202239 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202333 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202426 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202518 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202611 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.202955 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.203047 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.203259 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.203354 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.203562 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.203701 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.203873 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.203989 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.204256 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.204600 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.204918 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.205146 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.205689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.205812 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.205933 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.206045 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.206155 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.206274 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.206391 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.206501 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.206610 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.206759 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.206881 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.207003 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.207114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.207231 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.207344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.207454 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.207603 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.207796 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.208115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.208420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.208746 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.209055 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.209196 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.209360 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.209531 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.209665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.209866 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.209957 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.210188 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.210289 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.210529 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.210622 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.210880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.211056 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.211184 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.211386 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.211505 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.211751 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.211881 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.212089 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.212246 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.212395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.212582 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.212717 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.212954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.213056 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.213293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.213394 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.213600 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.213690 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.213908 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.214008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.214260 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.214368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.214512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.214642 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.214868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.214999 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.215179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.215338 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.215487 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.215578 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.215792 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.215891 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.216094 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.216264 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.216400 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.216497 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.216708 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.216799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.217011 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.217102 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.217320 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.217425 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.217623 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.217723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.217924 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.218015 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.218233 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.218326 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.218536 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.218634 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.218862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.218952 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.219170 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.219263 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.219472 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.219566 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.219776 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.219873 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.220076 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.220173 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.220376 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.220476 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.220677 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.220776 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.220984 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.221084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.221288 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.221391 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.221586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.221682 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.221901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.222005 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.222210 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.222298 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.222512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.222605 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.222851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.222959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.223157 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.223249 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.223457 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.223557 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.223758 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.223859 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.224068 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.224158 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.224382 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.224506 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.224693 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.224789 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.228319 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.228551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.228551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.228735 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.228835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.228923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.228923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229086 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229167 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229253 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229353 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229438 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229529 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229613 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229704 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229893 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.229985 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230069 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230151 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230241 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230334 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230418 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230508 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230703 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230789 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230890 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.230976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231066 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231157 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231241 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231497 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231578 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231578 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231904 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.231997 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232081 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232081 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232231 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232231 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232520 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232624 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232717 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232803 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232885 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.232976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233061 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233143 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233222 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233294 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233376 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233467 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233596 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233764 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.233912 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.234069 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.234229 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.234388 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.234545 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.234724 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.234863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.235040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.235156 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.235365 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.235480 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.235688 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.235799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.236012 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.236130 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.236316 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.236426 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.236624 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.236723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.236933 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.237042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.237241 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.237341 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.237550 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.237658 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.237862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.237971 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.238172 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.238273 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.238479 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.238579 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.238822 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.238940 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.239133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.239241 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.239442 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.239540 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.239748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.239857 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.240055 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.240157 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.240361 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.240461 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.240663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.240763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.240974 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.241081 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.241278 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.241385 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.241619 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.241728 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.241923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.242024 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.242200 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.242302 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.242484 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.242645 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.242799 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.242887 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.243164 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.243269 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.243473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.243569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.243789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.243889 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.244100 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.244242 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.244404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.244500 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.244713 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.244831 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.245068 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.245225 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.245361 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.245455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.245664 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.245755 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.246046 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.246137 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.246364 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.246482 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.246695 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.246804 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.247807 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.247896 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.247970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.248039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.248125 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.248212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.248293 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.248372 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.248879 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.248973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.249063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.249145 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.249219 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.249290 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.249604 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.249697 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.249779 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.249864 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.250123 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.250223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.250399 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.250600 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.250865 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.250960 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.251150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.251242 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.251528 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.251605 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.251828 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.252009 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.252092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.252172 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.252349 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.252475 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.252690 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.252796 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.253013 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.253117 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.253336 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.253428 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.253641 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.253733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.253952 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.254053 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.254262 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.254354 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.254584 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.254706 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.254931 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.255052 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.255245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.255357 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.255564 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.255665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.255867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.256006 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.256187 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.256285 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.256506 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.256597 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.256818 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.256972 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.257132 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.257256 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.257453 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.257549 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.257769 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.257869 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.258094 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.258200 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.258422 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.258546 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.258863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.258984 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.259175 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.259290 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.259482 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.259593 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.259791 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.259900 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.260097 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.260208 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.260402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.260529 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.260721 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.260856 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.261025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.261166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.261335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.261472 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.261644 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.261784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.261977 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.262107 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.262253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.262386 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.262555 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.262730 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.262902 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.263040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.263207 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.263354 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.263528 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.263667 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.263842 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.263978 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.264145 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.264285 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.264464 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.264591 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.264766 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.264915 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.265093 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.265221 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.265401 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.265543 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.265706 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.265859 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.266007 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.266165 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.266309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.266489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.266658 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.266830 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.266971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.267153 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.267290 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.267465 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.267618 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.267778 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.267944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.268084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.268253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.268390 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.268586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.268737 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.269096 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.269203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.269304 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.269391 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.269521 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.269668 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.269843 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.270000 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.270188 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.270315 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.270418 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.270700 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.270817 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.271008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.271115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.271327 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.271420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.271629 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.271730 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.272033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.272147 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.272277 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.272384 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.272534 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.272635 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.272830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.272970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.273135 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.273235 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.273438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.273529 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.273742 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.273841 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.274049 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.274147 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.274373 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.274467 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.274696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.274853 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.275009 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.275100 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.275333 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.275440 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.275639 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.275735 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.275963 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.276063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.276274 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.276384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.276583 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.276676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.276889 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.276993 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.277196 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.277302 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.277517 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.277616 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.277835 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.277927 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.278152 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.278257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.278469 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.278560 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.278808 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.278915 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.279126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.279234 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.279439 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.279539 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.279752 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.279850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.280061 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.280154 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.280377 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.280483 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.280696 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.280797 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.281009 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.281111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.281326 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.281574 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.281667 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.281902 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.282045 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.282215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.282316 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.282528 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.282722 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.282864 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.282967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.283179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.283286 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.283491 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.283741 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.283891 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.284082 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.284176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.284389 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.284488 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.284700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.284812 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.285073 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.285176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.285341 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.285470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.285662 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.285755 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.285980 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.286075 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.286292 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.286384 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.286607 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.286749 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.286942 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.287041 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.287254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.287355 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.287590 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.287690 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.287909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.288012 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.288214 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.288315 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.288524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.288624 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.288838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.288930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.289151 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.289257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.289461 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.289561 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.289771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.289901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.290163 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.290266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.290477 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.290569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.290808 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.290960 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.291119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.291223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.291431 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.291524 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.291743 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.291835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.292057 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.292156 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.292377 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.292478 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.292694 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.292863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.293005 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.293099 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.293315 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.293409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.293628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.293730 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.293943 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.294138 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.294269 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.294450 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.294607 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.294820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.294955 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.295181 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.295286 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.295465 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.295614 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.295784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.295877 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.296101 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.296387 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.296480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.296703 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.296800 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.297012 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.297120 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.297323 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.297416 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.297642 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.297736 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.297947 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.298040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.298268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.298359 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.298577 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.298732 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.298910 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.299048 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.299220 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.299326 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.299527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.299653 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.299838 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.300059 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.300153 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.300412 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.300508 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.300729 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.300820 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.301055 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.301145 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.301379 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.301479 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.301690 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.301781 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.302033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.302228 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.302333 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.302586 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.302752 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.302929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.303024 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.303252 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.303344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.303563 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.303655 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.303866 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.303958 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.304173 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.304279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.304483 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.304599 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.304791 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.304883 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.305096 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.305190 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.305413 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.305560 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.305744 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.305850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.306050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.306144 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.306358 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.306459 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.306700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.306817 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.306998 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.307111 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.307307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.307409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.307627 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.307734 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.307936 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.308041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.308269 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.308362 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.308580 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.308687 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.308886 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.308984 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.309191 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.309293 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.309498 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.309597 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.309801 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.309892 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.310106 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.310196 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.310407 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.310499 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.310739 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.310848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.311046 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.311140 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.311355 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.311461 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.311665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.311759 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.311975 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.312068 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.312291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.312385 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.312600 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.312693 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.312913 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.313014 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.313222 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.313322 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.313535 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.313656 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.313881 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.314008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.314186 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.314277 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.314506 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.314762 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.314860 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.315103 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.315206 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.315434 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.315562 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.315768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.315877 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.316100 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.316217 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.316409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.316525 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.316715 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.316958 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.317082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.317300 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.317393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.317624 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.317715 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.317935 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.318029 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.318246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.318339 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.318556 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.318723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.318898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.318998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.319207 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.319298 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.319517 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.319612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.319826 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.319920 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.320136 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.320236 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.320553 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.320671 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.320761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.320846 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.321045 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.321329 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.321425 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.321520 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.321718 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.321820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.322033 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.322135 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.322347 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.322459 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.322701 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.322811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.322993 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.323084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.323303 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.323402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.323617 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.323710 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.323925 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.324017 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.324240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.324388 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.324573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.324677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.324886 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.324988 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.325189 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.325284 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.325503 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.325660 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.325821 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.325952 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.326141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.326244 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.326459 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.326579 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.326815 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.326930 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.327134 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.327240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.327445 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.327538 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.327761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.327868 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.328084 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.328177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.328394 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.328504 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.328726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.328821 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.329068 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.329168 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.329398 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.329494 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.329720 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.329817 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.330026 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.330120 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.330333 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.330427 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.330638 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.330782 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.330969 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.331076 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.331298 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.331398 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.331629 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.331723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.331943 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.332043 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.332255 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.332360 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.332564 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.332662 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.332869 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.332962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.333177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.333281 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.333496 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.333590 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.333814 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.333909 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.334127 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.334232 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.334438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.334538 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.334774 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.334870 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.335099 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.335192 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.335410 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.335500 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.335722 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.335825 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.336033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.336149 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.336339 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.336434 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.336647 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.336760 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.337031 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.337139 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.337348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.337452 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.337667 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.337758 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.337982 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.338074 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.338296 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.338388 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.338608 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.338738 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.338946 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.339050 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.339277 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.339370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.339605 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.339710 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.339914 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.340015 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.340237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.340336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.340550 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.340651 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.340864 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.340956 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.341184 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.341283 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.341499 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.341601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.341823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.341914 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.342139 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.342238 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.342461 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.342562 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.342801 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.342898 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.343120 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.343214 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.343440 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.343538 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.343761 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.343853 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.344091 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.344197 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.344402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.344497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.344716 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.344809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.345022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.345172 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.345277 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 03:36:31.345391 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.345709 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.346068 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.346386 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.346723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.347042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.347352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 10 03:36:31.347603 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 10 03:36:31.369027 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_db.sqlalchemy.engines [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:36:31.370505 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_db.sqlalchemy.engines [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:36:31.433953 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.context [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e5db6ec-3f2c-49f5-9851-3e8c38c287f1(cell1) {{(pid=127952) load_cells /opt/stack/nova/nova/context.py:464}} Feb 10 03:36:31.435757 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.context [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e5db6ec-3f2c-49f5-9851-3e8c38c287f1(cell1) {{(pid=127951) load_cells /opt/stack/nova/nova/context.py:464}} Feb 10 03:36:31.438228 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:36:31.439877 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:36:31.440148 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:36:31.440680 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:36:31.441917 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:36:31.442640 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:36:31.442769 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:36:31.444733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:36:31.453735 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_db.sqlalchemy.engines [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:36:31.454535 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_db.sqlalchemy.engines [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:36:31.456062 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_db.sqlalchemy.engines [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:36:31.460832 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_db.sqlalchemy.engines [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:36:31.609956 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_db.sqlalchemy.engines [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:36:31.616575 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_db.sqlalchemy.engines [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 10 03:36:31.932310 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: WARNING keystonemiddleware.auth_token [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 10 03:36:31.939547 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: WARNING keystonemiddleware.auth_token [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 10 03:36:31.943101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: WARNING keystonemiddleware.auth_token [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 10 03:36:31.949917 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: WARNING keystonemiddleware.auth_token [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 10 03:36:32.287771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: WARNING keystonemiddleware.auth_token [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 10 03:36:32.291954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: WARNING keystonemiddleware.auth_token [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 10 03:36:32.293064 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: WARNING keystonemiddleware.auth_token [None req-e7d13a7b-87d9-4c42-a568-e6b1c3b4ac07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 10 03:36:32.297218 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: WARNING keystonemiddleware.auth_token [None req-8358c610-2f7c-481c-8e8d-cb6ac8a3642e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 10 03:36:32.298535 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56471b9ea9c0 pid: 127952 (default app) Feb 10 03:36:32.302630 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56471b9ea9c0 pid: 127951 (default app) Feb 10 03:37:05.531981 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-773a34ad-3667-4747-aa4d-9ebb22e09850 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Action: 'create', calling method: .version_select at 0x7fe95c2e6dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-430214741", "metadata": {"Type": "work"}}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:05.533677 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-773a34ad-3667-4747-aa4d-9ebb22e09850 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:37:05.534576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-773a34ad-3667-4747-aa4d-9ebb22e09850 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.787640 Feb 10 03:37:05.535338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Feb 10 03:37:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 790 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:37:05.768048 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-14ee86eb-6404-4875-83ea-13930ec0254c tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Action: 'create', calling method: .version_select at 0x7fe95c3319d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1020937450", "metadata": {"Type": "work"}}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:05.770168 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-14ee86eb-6404-4875-83ea-13930ec0254c tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:37:05.771561 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-14ee86eb-6404-4875-83ea-13930ec0254c tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.229327 Feb 10 03:37:05.772393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 1/2] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Feb 10 03:37:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 10 03:37:05.782916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d64f0551-413e-4d38-800d-332cb8866678 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Action: 'create', calling method: .version_select at 0x7fe95c1ec940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1877505187", "metadata": {"Type": "work"}}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:05.783506 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d64f0551-413e-4d38-800d-332cb8866678 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:37:05.784285 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d64f0551-413e-4d38-800d-332cb8866678 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006255 Feb 10 03:37:05.784830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Feb 10 03:37:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:37:05.795474 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-caecd303-e1e0-45bc-befd-d52c659f485b tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Calling method '.version_select at 0x7fe95c23b550>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:07.345843 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-caecd303-e1e0-45bc-befd-d52c659f485b tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] HTTP exception thrown: Volume tempest-invalid-315841468 could not be found. Feb 10 03:37:07.347217 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-caecd303-e1e0-45bc-befd-d52c659f485b tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Returning 404 to user: Volume tempest-invalid-315841468 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:37:07.348498 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-caecd303-e1e0-45bc-befd-d52c659f485b tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-315841468" status: 404 len: 98 microversion: 2.1 time: 1.557097 Feb 10 03:37:07.360673 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1c68b313-eeb7-499f-97b7-e139354e7cde tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005278 Feb 10 03:37:07.365542 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1214 bytes} [Thu Feb 10 03:37:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-315841468 => generated 98 bytes in 1575 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 10 03:37:07.367663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 3/5] 10.222.0.32 () {58 vars in 1139 bytes} [Thu Feb 10 03:37:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 10 03:37:07.373722 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f7216bbe-dd85-45bf-a54f-21b60f8b62d0 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006883 Feb 10 03:37:07.386576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-62f90d90-d408-4da4-b862-9bef84090e11 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Calling method '.version_select at 0x7fe95c1ec8b0>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:07.393445 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 3/6] 10.222.0.32 () {58 vars in 1136 bytes} [Thu Feb 10 03:37:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 10 03:37:08.001402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1961005440", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "8bd4cd27-a10d-4c56-b40b-6272d0715cdc"}]}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:08.088178 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-62f90d90-d408-4da4-b862-9bef84090e11 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] HTTP exception thrown: Volume 1beb72bb-01d9-4ff5-87c5-b4b300d085df could not be found. Feb 10 03:37:08.089121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-62f90d90-d408-4da4-b862-9bef84090e11 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Returning 404 to user: Volume 1beb72bb-01d9-4ff5-87c5-b4b300d085df could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:37:08.090427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-62f90d90-d408-4da4-b862-9bef84090e11 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/1beb72bb-01d9-4ff5-87c5-b4b300d085df" status: 404 len: 109 microversion: 2.1 time: 0.708214 Feb 10 03:37:08.091101 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Feb 10 03:37:07 2022] DELETE /compute/v2.1/os-volumes/1beb72bb-01d9-4ff5-87c5-b4b300d085df => generated 109 bytes in 710 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:37:08.101557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-67465cc2-9ddf-4ac7-b28d-7501a65cf589 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Calling method '.version_select at 0x7fe95c76a5e0>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:08.211016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] validate_networks() for [('8bd4cd27-a10d-4c56-b40b-6272d0715cdc', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:37:08.563376 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-67465cc2-9ddf-4ac7-b28d-7501a65cf589 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] HTTP exception thrown: Volume 21326e04-1142-4789-b18a-dba7d8a6dd9c could not be found. Feb 10 03:37:08.563962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-67465cc2-9ddf-4ac7-b28d-7501a65cf589 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] Returning 404 to user: Volume 21326e04-1142-4789-b18a-dba7d8a6dd9c could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:37:08.564959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-67465cc2-9ddf-4ac7-b28d-7501a65cf589 tempest-VolumesNegativeTest-2101089279 tempest-VolumesNegativeTest-2101089279-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/21326e04-1142-4789-b18a-dba7d8a6dd9c" status: 404 len: 109 microversion: 2.1 time: 0.468471 Feb 10 03:37:08.565656 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:37:08 2022] GET /compute/v2.1/os-volumes/21326e04-1142-4789-b18a-dba7d8a6dd9c => generated 109 bytes in 470 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 10 03:37:08.670458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-73f17541-5747-4896-affd-a1aac5966e94 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95c15b310>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:08.779746 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-73f17541-5747-4896-affd-a1aac5966e94 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/900a68a6-66cc-4c82-91f5-7d7fd9976002" status: 200 len: 350 microversion: 2.1 time: 0.112993 Feb 10 03:37:08.780731 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 6/9] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:37:08 2022] GET /compute/v2.1/os-volumes/900a68a6-66cc-4c82-91f5-7d7fd9976002 => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:37:09.888765 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1078666690", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "4fceb00b-34fd-4a2b-b18c-a9d9c74a66d0"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:10.242095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] validate_networks() for [('4fceb00b-34fd-4a2b-b18c-a9d9c74a66d0', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:37:10.603550 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:37:10.604221 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:37:10.604427 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:37:10.605024 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:37:10.605617 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:37:10.637366 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:10.641747 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:10.647419 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:10.649825 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:10.789067 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Getting quotas for project b1ad4b9bfe7941d3baa9c36cf551a874. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:37:10.796683 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Getting quotas for user 003425f2d3474769b4f996f680088f94 and project b1ad4b9bfe7941d3baa9c36cf551a874. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:37:10.821792 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:37:10.826431 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:37:10.951651 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a58fd492-437f-4e67-ac88-baeae1173c0c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.229866 Feb 10 03:37:10.952972 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 4/10] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 10 03:37:10.959140 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dd2d2cbb-20ad-404e-b55c-1997c5e62edb tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95b84c160>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:11.036782 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dd2d2cbb-20ad-404e-b55c-1997c5e62edb tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/91636f03-9b0d-4517-a5d6-3c92c36d573c" status: 200 len: 350 microversion: 2.1 time: 0.082400 Feb 10 03:37:11.037651 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 5/11] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:37:10 2022] GET /compute/v2.1/os-volumes/91636f03-9b0d-4517-a5d6-3c92c36d573c => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:11.042765 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-883d7f42-1bf5-4640-8cad-6113b52304da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:11.053903 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-883d7f42-1bf5-4640-8cad-6113b52304da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:12.149021 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-883d7f42-1bf5-4640-8cad-6113b52304da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:12.198551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-883d7f42-1bf5-4640-8cad-6113b52304da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1215 microversion: 2.1 time: 1.157457 Feb 10 03:37:12.201999 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:11 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1215 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:12.953277 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1fbc5bc9-a1c0-4f58-bd1d-fd947f72f3fc tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95b86cb80>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:13.077390 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1fbc5bc9-a1c0-4f58-bd1d-fd947f72f3fc tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/55146c8d-42a1-449d-9c0d-a16f455fd26a" status: 200 len: 349 microversion: 2.1 time: 0.128357 Feb 10 03:37:13.077970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:37:12 2022] GET /compute/v2.1/os-volumes/55146c8d-42a1-449d-9c0d-a16f455fd26a => generated 349 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:13.101833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3b2307c3-83ff-4d66-a618-3fd2c9b1e843 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95b87ce50>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:13.392169 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3b2307c3-83ff-4d66-a618-3fd2c9b1e843 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.295417 Feb 10 03:37:13.393142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 8/14] 10.222.0.32 () {58 vars in 1133 bytes} [Thu Feb 10 03:37:13 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:13.397385 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7edfe081-8f71-43a0-bfeb-6595cf7aeb34 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:13.398099 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7edfe081-8f71-43a0-bfeb-6595cf7aeb34 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:13.435373 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7edfe081-8f71-43a0-bfeb-6595cf7aeb34 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:13.435890 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7edfe081-8f71-43a0-bfeb-6595cf7aeb34 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:13.436755 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7edfe081-8f71-43a0-bfeb-6595cf7aeb34 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:13.437195 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7edfe081-8f71-43a0-bfeb-6595cf7aeb34 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:14.007858 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7edfe081-8f71-43a0-bfeb-6595cf7aeb34 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:14.047851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7edfe081-8f71-43a0-bfeb-6595cf7aeb34 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1219 microversion: 2.1 time: 0.651841 Feb 10 03:37:14.051887 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 9/15] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:13 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1219 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:14.064610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:37:14.065865 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:37:14.066561 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:37:14.067174 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:37:14.067921 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:37:14.071041 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e91bb996-17b3-461f-9761-e177298b9a75 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95af908b0>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:14.093377 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:14.094315 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:14.096480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:14.097138 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:14.135626 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Getting quotas for project d7bf7bed71094487b57906e39d043543. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:37:14.143455 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Getting quotas for user 5adf0f1d005d4a1eb0136d4593b094b5 and project d7bf7bed71094487b57906e39d043543. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:37:14.166563 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:37:14.173825 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:37:14.331446 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e91bb996-17b3-461f-9761-e177298b9a75 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.278028 Feb 10 03:37:14.332038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 10/16] 10.222.0.32 () {58 vars in 1148 bytes} [Thu Feb 10 03:37:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:14.350508 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1e3e0f27-6c0f-4199-8f10-d2c07e5357e1 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95af87280>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:14.380852 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-9364061c-966e-4d83-a450-48cfee0dac48 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.723660 Feb 10 03:37:14.381494 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 7/17] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:37:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 10 03:37:14.399485 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d5c54ce2-edc8-493f-96ea-c7b7e72eecc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:14.400631 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d5c54ce2-edc8-493f-96ea-c7b7e72eecc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:14.586638 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1e3e0f27-6c0f-4199-8f10-d2c07e5357e1 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.240268 Feb 10 03:37:14.588225 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 11/18] 10.222.0.32 () {58 vars in 1133 bytes} [Thu Feb 10 03:37:14 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:14.600994 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3070f2e3-6a44-43b5-aa6c-463d8b463ea0 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95af90820>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:14.603973 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d5c54ce2-edc8-493f-96ea-c7b7e72eecc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:14.643595 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d5c54ce2-edc8-493f-96ea-c7b7e72eecc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1218 microversion: 2.1 time: 0.254880 Feb 10 03:37:14.651028 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 8/19] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:14 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:14.792828 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3070f2e3-6a44-43b5-aa6c-463d8b463ea0 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.196291 Feb 10 03:37:14.794603 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 12/20] 10.222.0.32 () {58 vars in 1166 bytes} [Thu Feb 10 03:37:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:37:14.805513 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-117ff7a8-d223-4a0b-9ca9-d60906b166b6 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95b880550>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:14.984781 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-117ff7a8-d223-4a0b-9ca9-d60906b166b6 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.141611 Feb 10 03:37:14.984781 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 9/21] 10.222.0.32 () {58 vars in 1169 bytes} [Thu Feb 10 03:37:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:14.985571 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c58ab9a8-2392-4632-b230-f15312449847 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95b878160>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:15.066221 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0f082b87-3b9b-41ac-8825-765b6d1ba281 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:15.070433 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0f082b87-3b9b-41ac-8825-765b6d1ba281 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:15.087898 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f082b87-3b9b-41ac-8825-765b6d1ba281 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:15.090492 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f082b87-3b9b-41ac-8825-765b6d1ba281 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:15.093629 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f082b87-3b9b-41ac-8825-765b6d1ba281 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:15.094082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f082b87-3b9b-41ac-8825-765b6d1ba281 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:15.164828 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c58ab9a8-2392-4632-b230-f15312449847 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.211601 Feb 10 03:37:15.165417 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 13/22] 10.222.0.32 () {58 vars in 1154 bytes} [Thu Feb 10 03:37:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:15.176759 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-36e8564b-de63-4788-a03c-57db0c2aa2e0 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95af8a430>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:15.409754 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0f082b87-3b9b-41ac-8825-765b6d1ba281 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:15.447855 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-36e8564b-de63-4788-a03c-57db0c2aa2e0 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.275046 Feb 10 03:37:15.448427 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 14/23] 10.222.0.32 () {58 vars in 1187 bytes} [Thu Feb 10 03:37:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:37:15.449086 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0f082b87-3b9b-41ac-8825-765b6d1ba281 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1219 microversion: 2.1 time: 0.378324 Feb 10 03:37:15.459731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9bfb8d11-9d05-4f6c-9592-3b23f4a3aec9 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] Calling method '.version_select at 0x7fe95af8a670>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:15.462791 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 10/24] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:15 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1219 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:15.665044 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-01caaa58-fa79-4b13-8fa6-899fbf9d87b7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:15.665673 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-01caaa58-fa79-4b13-8fa6-899fbf9d87b7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:15.682887 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9bfb8d11-9d05-4f6c-9592-3b23f4a3aec9 tempest-VolumesTestJSON-881072117 tempest-VolumesTestJSON-881072117-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.226627 Feb 10 03:37:15.684902 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 15/25] 10.222.0.32 () {58 vars in 1154 bytes} [Thu Feb 10 03:37:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:15.823916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-01caaa58-fa79-4b13-8fa6-899fbf9d87b7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:15.836516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-01caaa58-fa79-4b13-8fa6-899fbf9d87b7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1218 microversion: 2.1 time: 0.177064 Feb 10 03:37:15.838444 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 11/26] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:15 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:16.271083 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4566e188-1aae-4606-b135-ff915f7c52ac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'create', calling method: .version_select at 0x7fe95af8adc0>, body: {"keypair": {"name": "tempest-keypair-321031094"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:16.318009 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-4566e188-1aae-4606-b135-ff915f7c52ac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:37:16.328525 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-4566e188-1aae-4606-b135-ff915f7c52ac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for user d637094d14264332b6a947fe1e5c0ad8 and project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:37:16.465550 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a58bf828-dc8c-4056-9e9f-99724606632b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:16.466816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a58bf828-dc8c-4056-9e9f-99724606632b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:16.473880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a58bf828-dc8c-4056-9e9f-99724606632b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:16.479307 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a58bf828-dc8c-4056-9e9f-99724606632b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:16.480363 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a58bf828-dc8c-4056-9e9f-99724606632b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:16.480945 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a58bf828-dc8c-4056-9e9f-99724606632b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:16.628356 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a58bf828-dc8c-4056-9e9f-99724606632b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:16.638040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a58bf828-dc8c-4056-9e9f-99724606632b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1267 microversion: 2.1 time: 0.176184 Feb 10 03:37:16.653811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 12/27] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:16 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:16.854289 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8a556f27-8b4b-43a1-b17f-713797948aa5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:16.855119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8a556f27-8b4b-43a1-b17f-713797948aa5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:16.867242 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a556f27-8b4b-43a1-b17f-713797948aa5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:16.867957 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a556f27-8b4b-43a1-b17f-713797948aa5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:16.868929 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a556f27-8b4b-43a1-b17f-713797948aa5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:16.869518 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a556f27-8b4b-43a1-b17f-713797948aa5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:16.980555 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-4566e188-1aae-4606-b135-ff915f7c52ac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:37:16.992717 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-4566e188-1aae-4606-b135-ff915f7c52ac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for user d637094d14264332b6a947fe1e5c0ad8 and project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:37:17.016094 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4566e188-1aae-4606-b135-ff915f7c52ac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.040606 Feb 10 03:37:17.025348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 16/28] 10.222.0.32 () {62 vars in 1198 bytes} [Thu Feb 10 03:37:15 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1051 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 10 03:37:17.224944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8a556f27-8b4b-43a1-b17f-713797948aa5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:17.236074 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8a556f27-8b4b-43a1-b17f-713797948aa5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1270 microversion: 2.1 time: 0.386539 Feb 10 03:37:17.237217 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 13/29] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:16 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1270 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:17.671275 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-15577fca-6ff6-4110-8f20-59b082d08331 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:17.672129 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-15577fca-6ff6-4110-8f20-59b082d08331 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:17.678688 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-15577fca-6ff6-4110-8f20-59b082d08331 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:17.679133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-15577fca-6ff6-4110-8f20-59b082d08331 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:17.680316 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-15577fca-6ff6-4110-8f20-59b082d08331 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:17.680383 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-15577fca-6ff6-4110-8f20-59b082d08331 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:17.995194 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-15577fca-6ff6-4110-8f20-59b082d08331 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:18.004943 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-15577fca-6ff6-4110-8f20-59b082d08331 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1273 microversion: 2.1 time: 0.337341 Feb 10 03:37:18.015457 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 17/30] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:17 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:18.264645 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b6318343-aaa3-4b08-b5b6-b9dfd779b34d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:18.265280 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b6318343-aaa3-4b08-b5b6-b9dfd779b34d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:18.290393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b6318343-aaa3-4b08-b5b6-b9dfd779b34d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:18.292599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b6318343-aaa3-4b08-b5b6-b9dfd779b34d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:18.311445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b6318343-aaa3-4b08-b5b6-b9dfd779b34d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:18.315119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b6318343-aaa3-4b08-b5b6-b9dfd779b34d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:18.657713 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b6318343-aaa3-4b08-b5b6-b9dfd779b34d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:18.669737 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b6318343-aaa3-4b08-b5b6-b9dfd779b34d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1276 microversion: 2.1 time: 0.419560 Feb 10 03:37:18.672976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 14/31] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:18 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1276 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:19.032381 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4a6d401b-3f56-4d76-8eef-b5f69ca37b21 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:19.033918 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4a6d401b-3f56-4d76-8eef-b5f69ca37b21 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:19.045022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4a6d401b-3f56-4d76-8eef-b5f69ca37b21 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:19.045686 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4a6d401b-3f56-4d76-8eef-b5f69ca37b21 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:19.047880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4a6d401b-3f56-4d76-8eef-b5f69ca37b21 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:19.055453 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4a6d401b-3f56-4d76-8eef-b5f69ca37b21 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:19.260265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4a6d401b-3f56-4d76-8eef-b5f69ca37b21 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:19.275878 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4a6d401b-3f56-4d76-8eef-b5f69ca37b21 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1273 microversion: 2.1 time: 0.247240 Feb 10 03:37:19.276818 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 18/32] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:19 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:19.690622 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-49bc5ed6-80ce-4a4a-a060-2158db3c7279 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:19.691255 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-49bc5ed6-80ce-4a4a-a060-2158db3c7279 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:19.701797 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-49bc5ed6-80ce-4a4a-a060-2158db3c7279 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:19.709011 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-49bc5ed6-80ce-4a4a-a060-2158db3c7279 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:19.716359 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-49bc5ed6-80ce-4a4a-a060-2158db3c7279 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:19.717148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-49bc5ed6-80ce-4a4a-a060-2158db3c7279 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:20.294434 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c8fdccde-e6e6-423c-b8f6-61b292a588d3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:20.295856 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c8fdccde-e6e6-423c-b8f6-61b292a588d3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:20.304695 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c8fdccde-e6e6-423c-b8f6-61b292a588d3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:20.310057 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c8fdccde-e6e6-423c-b8f6-61b292a588d3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:20.313716 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c8fdccde-e6e6-423c-b8f6-61b292a588d3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:20.316102 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c8fdccde-e6e6-423c-b8f6-61b292a588d3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:20.919936 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-49bc5ed6-80ce-4a4a-a060-2158db3c7279 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:20.938120 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-49bc5ed6-80ce-4a4a-a060-2158db3c7279 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1276 microversion: 2.1 time: 1.249897 Feb 10 03:37:20.952883 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 15/33] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:19 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1276 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:21.959106 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f42589fc-addd-48d6-be10-56b9c39504b1 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:21.960475 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f42589fc-addd-48d6-be10-56b9c39504b1 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:21.976632 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f42589fc-addd-48d6-be10-56b9c39504b1 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:21.979553 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f42589fc-addd-48d6-be10-56b9c39504b1 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:21.981821 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f42589fc-addd-48d6-be10-56b9c39504b1 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:21.984341 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f42589fc-addd-48d6-be10-56b9c39504b1 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:22.063636 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c8fdccde-e6e6-423c-b8f6-61b292a588d3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:22.072046 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c8fdccde-e6e6-423c-b8f6-61b292a588d3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 1.782782 Feb 10 03:37:22.072639 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 19/34] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:20 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:22.419689 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f42589fc-addd-48d6-be10-56b9c39504b1 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:22.447635 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f42589fc-addd-48d6-be10-56b9c39504b1 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1276 microversion: 2.1 time: 0.482653 Feb 10 03:37:22.461656 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 16/35] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:21 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1276 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:23.091091 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6c1d8f6a-f635-4a62-b8d7-52f37aaae4e5 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:23.092374 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6c1d8f6a-f635-4a62-b8d7-52f37aaae4e5 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:23.107857 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6c1d8f6a-f635-4a62-b8d7-52f37aaae4e5 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:23.108317 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6c1d8f6a-f635-4a62-b8d7-52f37aaae4e5 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:23.109125 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6c1d8f6a-f635-4a62-b8d7-52f37aaae4e5 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:23.119432 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6c1d8f6a-f635-4a62-b8d7-52f37aaae4e5 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:23.470061 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-678c4858-5061-46cd-900c-d6af4b8ba066 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:23.471354 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-678c4858-5061-46cd-900c-d6af4b8ba066 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:23.486177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-678c4858-5061-46cd-900c-d6af4b8ba066 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:23.488099 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-678c4858-5061-46cd-900c-d6af4b8ba066 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:23.489851 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-678c4858-5061-46cd-900c-d6af4b8ba066 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:23.492121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-678c4858-5061-46cd-900c-d6af4b8ba066 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:23.653253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-678c4858-5061-46cd-900c-d6af4b8ba066 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:23.667823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-678c4858-5061-46cd-900c-d6af4b8ba066 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1276 microversion: 2.1 time: 0.206767 Feb 10 03:37:23.668477 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 17/36] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:23 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:24.429492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6c1d8f6a-f635-4a62-b8d7-52f37aaae4e5 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:24.449731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6c1d8f6a-f635-4a62-b8d7-52f37aaae4e5 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 1.359293 Feb 10 03:37:24.450811 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 20/37] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:23 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:24.694085 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-952f2661-8cc0-4189-ac6d-706c79261aed tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:24.695598 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-952f2661-8cc0-4189-ac6d-706c79261aed tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:24.716453 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-952f2661-8cc0-4189-ac6d-706c79261aed tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:24.717167 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-952f2661-8cc0-4189-ac6d-706c79261aed tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:24.725725 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-952f2661-8cc0-4189-ac6d-706c79261aed tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:24.731006 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-952f2661-8cc0-4189-ac6d-706c79261aed tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:25.518021 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-952f2661-8cc0-4189-ac6d-706c79261aed tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:25.521716 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-195b7e1f-e267-49d4-a4ad-6ab3f623dae4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'create', calling method: .version_select at 0x7fe95af6d040>, body: {"keypair": {"name": "tempest-keypair-807446414"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:25.526866 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-952f2661-8cc0-4189-ac6d-706c79261aed tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.845907 Feb 10 03:37:25.530636 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 18/38] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:24 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:25.551002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7d1e0ed7-0b95-4391-846c-5a864cd06608 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:25.558467 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7d1e0ed7-0b95-4391-846c-5a864cd06608 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:25.567029 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-195b7e1f-e267-49d4-a4ad-6ab3f623dae4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:37:25.578392 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-195b7e1f-e267-49d4-a4ad-6ab3f623dae4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for user fc1ef6f6170f4ccb9e3b439ac3fd56e0 and project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:37:25.579393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d1e0ed7-0b95-4391-846c-5a864cd06608 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:25.579896 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d1e0ed7-0b95-4391-846c-5a864cd06608 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:25.584909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d1e0ed7-0b95-4391-846c-5a864cd06608 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:25.585546 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d1e0ed7-0b95-4391-846c-5a864cd06608 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:26.034197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-195b7e1f-e267-49d4-a4ad-6ab3f623dae4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:37:26.042905 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-195b7e1f-e267-49d4-a4ad-6ab3f623dae4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for user fc1ef6f6170f4ccb9e3b439ac3fd56e0 and project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:37:26.079690 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-195b7e1f-e267-49d4-a4ad-6ab3f623dae4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.135485 Feb 10 03:37:26.083241 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 21/39] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Feb 10 03:37:24 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:26.126042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7d1e0ed7-0b95-4391-846c-5a864cd06608 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:26.135681 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7d1e0ed7-0b95-4391-846c-5a864cd06608 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.602239 Feb 10 03:37:26.146622 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 19/40] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:25 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:26.551166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-cd28f686-5d8d-4f6b-abda-8f15a516b3f6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:26.552800 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-cd28f686-5d8d-4f6b-abda-8f15a516b3f6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:26.579267 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cd28f686-5d8d-4f6b-abda-8f15a516b3f6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:26.586223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cd28f686-5d8d-4f6b-abda-8f15a516b3f6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:26.588787 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cd28f686-5d8d-4f6b-abda-8f15a516b3f6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:26.590487 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cd28f686-5d8d-4f6b-abda-8f15a516b3f6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:27.163759 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c694b00d-c28c-44fc-a645-e9db926d7473 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:27.164530 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c694b00d-c28c-44fc-a645-e9db926d7473 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:27.175343 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c694b00d-c28c-44fc-a645-e9db926d7473 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:27.178589 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c694b00d-c28c-44fc-a645-e9db926d7473 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:27.179838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c694b00d-c28c-44fc-a645-e9db926d7473 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:27.191596 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c694b00d-c28c-44fc-a645-e9db926d7473 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:27.654030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cd28f686-5d8d-4f6b-abda-8f15a516b3f6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:27.697185 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-cd28f686-5d8d-4f6b-abda-8f15a516b3f6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 1.147357 Feb 10 03:37:27.707823 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 22/41] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:26 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:28.110810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-7c4aa58c-88ae-40bb-9ef8-dbf95d228a43 req-b07c8672-e205-4c8d-b9c0-d2d8b100351c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84018c6b-a22d-4280-a1a2-e0f2c315c2ce", "tag": "df41c157-7d92-4a0b-b955-e6573b3cc8f2"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:28.113800 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:28.113800 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:37:28.155233 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-7c4aa58c-88ae-40bb-9ef8-dbf95d228a43 req-b07c8672-e205-4c8d-b9c0-d2d8b100351c service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:28.157955 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-7c4aa58c-88ae-40bb-9ef8-dbf95d228a43 req-b07c8672-e205-4c8d-b9c0-d2d8b100351c service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:28.225501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-7c4aa58c-88ae-40bb-9ef8-dbf95d228a43 req-b07c8672-e205-4c8d-b9c0-d2d8b100351c service nova] Creating event network-changed:df41c157-7d92-4a0b-b955-e6573b3cc8f2 for instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce on hv-cinder-82806 Feb 10 03:37:28.230989 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-7c4aa58c-88ae-40bb-9ef8-dbf95d228a43 req-b07c8672-e205-4c8d-b9c0-d2d8b100351c service nova] Acquired lock "compute-rpcapi-router" {{(pid=127951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 10 03:37:28.239876 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5ba240d-1a0c-40a8-a785-094a7a1c43c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:28.240867 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5ba240d-1a0c-40a8-a785-094a7a1c43c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:28.243818 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5ba240d-1a0c-40a8-a785-094a7a1c43c6 None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:28.250085 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5ba240d-1a0c-40a8-a785-094a7a1c43c6 None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:28.285723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.compute.rpcapi [None req-f5ba240d-1a0c-40a8-a785-094a7a1c43c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 10 03:37:28.286960 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5ba240d-1a0c-40a8-a785-094a7a1c43c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=127951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 10 03:37:28.338114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f5ba240d-1a0c-40a8-a785-094a7a1c43c6 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.631347 Feb 10 03:37:28.341992 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 23/42] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:28.613211 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c694b00d-c28c-44fc-a645-e9db926d7473 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:28.622710 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c694b00d-c28c-44fc-a645-e9db926d7473 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 1.463155 Feb 10 03:37:28.632720 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 20/43] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:27 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:28.722827 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-224a01f0-ed77-4726-ad52-e996c18c3b59 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:28.727035 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-224a01f0-ed77-4726-ad52-e996c18c3b59 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:28.759890 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-224a01f0-ed77-4726-ad52-e996c18c3b59 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:28.760286 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-224a01f0-ed77-4726-ad52-e996c18c3b59 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:28.761216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-224a01f0-ed77-4726-ad52-e996c18c3b59 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:28.761789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-224a01f0-ed77-4726-ad52-e996c18c3b59 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:29.112653 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-1a51fbc0-351e-4ce9-87e7-d1a115730710 req-759e42e3-d08d-49a3-b430-4ac13245633e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28168573-b016-4c85-a32c-158c4155cd28", "tag": "beb068b9-e15c-4f4f-92d7-1c14f685b47d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:29.115456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:29.115456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:37:29.150087 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-1a51fbc0-351e-4ce9-87e7-d1a115730710 req-759e42e3-d08d-49a3-b430-4ac13245633e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:29.152753 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-1a51fbc0-351e-4ce9-87e7-d1a115730710 req-759e42e3-d08d-49a3-b430-4ac13245633e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:29.214726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-1a51fbc0-351e-4ce9-87e7-d1a115730710 req-759e42e3-d08d-49a3-b430-4ac13245633e service nova] Creating event network-changed:beb068b9-e15c-4f4f-92d7-1c14f685b47d for instance 28168573-b016-4c85-a32c-158c4155cd28 on hv-cinder-82806 Feb 10 03:37:29.215590 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-1a51fbc0-351e-4ce9-87e7-d1a115730710 req-759e42e3-d08d-49a3-b430-4ac13245633e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 10 03:37:29.217120 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e1f2c982-5f73-489c-aca7-c68bb284b484 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:29.217792 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e1f2c982-5f73-489c-aca7-c68bb284b484 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:29.218940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e1f2c982-5f73-489c-aca7-c68bb284b484 None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:29.220004 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e1f2c982-5f73-489c-aca7-c68bb284b484 None None] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:29.235921 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.compute.rpcapi [None req-e1f2c982-5f73-489c-aca7-c68bb284b484 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 10 03:37:29.237785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e1f2c982-5f73-489c-aca7-c68bb284b484 None None] Releasing lock "compute-rpcapi-router" {{(pid=127952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 10 03:37:29.283778 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e1f2c982-5f73-489c-aca7-c68bb284b484 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483220 Feb 10 03:37:29.284393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 21/44] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:37:29.653773 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4ab19297-625f-40b9-87a1-3ac396c8b811 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:29.656116 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4ab19297-625f-40b9-87a1-3ac396c8b811 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:29.670223 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ab19297-625f-40b9-87a1-3ac396c8b811 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:29.672628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ab19297-625f-40b9-87a1-3ac396c8b811 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:29.674593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ab19297-625f-40b9-87a1-3ac396c8b811 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:29.676308 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ab19297-625f-40b9-87a1-3ac396c8b811 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:30.153338 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-224a01f0-ed77-4726-ad52-e996c18c3b59 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:30.165290 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-224a01f0-ed77-4726-ad52-e996c18c3b59 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 1.451185 Feb 10 03:37:30.190789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 24/45] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:28 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:30.197204 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-999010515", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2276b970-ba53-4cdf-8089-151cb82a4e87"}], "security_groups": [{"name": "tempest-securitygroup--336145040"}], "key_name": "tempest-keypair-321031094", "user_data": "}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:30.299336 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4ab19297-625f-40b9-87a1-3ac396c8b811 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:30.332660 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4ab19297-625f-40b9-87a1-3ac396c8b811 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.677348 Feb 10 03:37:30.337325 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 22/46] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:29 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:30.705590 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] validate_networks() for [('2276b970-ba53-4cdf-8089-151cb82a4e87', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:37:31.184249 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-818b2fa4-7431-4d66-8eec-bf806aba8d67 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:31.184992 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-818b2fa4-7431-4d66-8eec-bf806aba8d67 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:31.202002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-818b2fa4-7431-4d66-8eec-bf806aba8d67 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:31.206798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-818b2fa4-7431-4d66-8eec-bf806aba8d67 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:31.213404 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-818b2fa4-7431-4d66-8eec-bf806aba8d67 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:31.214064 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-818b2fa4-7431-4d66-8eec-bf806aba8d67 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:32.466349 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-818b2fa4-7431-4d66-8eec-bf806aba8d67 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:32.477557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-818b2fa4-7431-4d66-8eec-bf806aba8d67 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 1.298253 Feb 10 03:37:32.483063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 23/47] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:31 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:32.499751 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a3be4990-416b-42a5-8b1b-d070ebba795b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:32.501009 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a3be4990-416b-42a5-8b1b-d070ebba795b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:32.510911 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a3be4990-416b-42a5-8b1b-d070ebba795b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:32.519624 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a3be4990-416b-42a5-8b1b-d070ebba795b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:32.521160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a3be4990-416b-42a5-8b1b-d070ebba795b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:32.521925 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a3be4990-416b-42a5-8b1b-d070ebba795b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:33.112179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a3be4990-416b-42a5-8b1b-d070ebba795b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:33.126248 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a3be4990-416b-42a5-8b1b-d070ebba795b tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.641492 Feb 10 03:37:33.127309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:32 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:33.147197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:37:33.148505 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:37:33.149196 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:37:33.150056 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:37:33.150810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:37:33.165675 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:33.166830 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:33.168608 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:33.169378 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:33.210967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:37:33.217621 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for user d637094d14264332b6a947fe1e5c0ad8 and project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:37:33.232854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:37:33.236134 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:37:33.317254 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-caf81d7e-da4d-48e0-89b3-88865bb115e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.124731 Feb 10 03:37:33.319636 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 25/49] 10.222.0.32 () {62 vars in 1187 bytes} [Thu Feb 10 03:37:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3128 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 10 03:37:33.329555 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6b4dd6da-bd21-4f4f-8138-9acf9e8fa0e1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:33.330370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6b4dd6da-bd21-4f4f-8138-9acf9e8fa0e1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:33.462510 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6b4dd6da-bd21-4f4f-8138-9acf9e8fa0e1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:33.472466 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6b4dd6da-bd21-4f4f-8138-9acf9e8fa0e1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:33.475245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6b4dd6da-bd21-4f4f-8138-9acf9e8fa0e1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:33.477560 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6b4dd6da-bd21-4f4f-8138-9acf9e8fa0e1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1280 microversion: 2.20 time: 0.151765 Feb 10 03:37:33.479458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 25/50] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:33 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:33.500607 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ad8fad5c-3738-41cf-a90f-0d3bf2528e89 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:33.501299 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ad8fad5c-3738-41cf-a90f-0d3bf2528e89 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:33.507653 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ad8fad5c-3738-41cf-a90f-0d3bf2528e89 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:33.508431 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ad8fad5c-3738-41cf-a90f-0d3bf2528e89 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:33.509447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ad8fad5c-3738-41cf-a90f-0d3bf2528e89 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:33.510350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ad8fad5c-3738-41cf-a90f-0d3bf2528e89 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:33.970926 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ad8fad5c-3738-41cf-a90f-0d3bf2528e89 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:33.980814 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ad8fad5c-3738-41cf-a90f-0d3bf2528e89 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.484502 Feb 10 03:37:33.988299 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 26/51] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:33 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:34.144634 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3060aca7-ed67-45bd-8794-9aa02caa1dda tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:34.145563 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3060aca7-ed67-45bd-8794-9aa02caa1dda tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:34.154774 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3060aca7-ed67-45bd-8794-9aa02caa1dda tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:34.155910 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3060aca7-ed67-45bd-8794-9aa02caa1dda tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:34.163695 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3060aca7-ed67-45bd-8794-9aa02caa1dda tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:34.164768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3060aca7-ed67-45bd-8794-9aa02caa1dda tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:34.509178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:34.511923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:34.525494 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:34.526992 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:34.528398 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:34.529089 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:34.615564 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3060aca7-ed67-45bd-8794-9aa02caa1dda tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:34.624483 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3060aca7-ed67-45bd-8794-9aa02caa1dda tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.484423 Feb 10 03:37:34.631603 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 26/52] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:34 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:34.682226 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:34.691751 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:34.695275 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:34.698553 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c674cbbb-8802-4d2e-a2f8-86c7f36a0160 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1332 microversion: 2.20 time: 0.204438 Feb 10 03:37:34.698983 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 27/53] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:34 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1332 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:37:35.014235 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a6409d06-22c8-4cfe-8e47-bf6f2c065115 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:35.015029 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a6409d06-22c8-4cfe-8e47-bf6f2c065115 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:35.030622 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a6409d06-22c8-4cfe-8e47-bf6f2c065115 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:35.030885 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a6409d06-22c8-4cfe-8e47-bf6f2c065115 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:35.032200 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a6409d06-22c8-4cfe-8e47-bf6f2c065115 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:35.038374 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a6409d06-22c8-4cfe-8e47-bf6f2c065115 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:35.146603 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2103609586", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d05c7b61-b2b5-4d63-9ad8-889925a1fb38"}], "security_groups": [{"name": "tempest-securitygroup--766247533"}], "key_name": "tempest-keypair-807446414", "user_data": "}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:35.352556 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] validate_networks() for [('d05c7b61-b2b5-4d63-9ad8-889925a1fb38', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:37:35.383830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a6409d06-22c8-4cfe-8e47-bf6f2c065115 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:35.397262 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a6409d06-22c8-4cfe-8e47-bf6f2c065115 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.387761 Feb 10 03:37:35.399256 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 27/54] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:35 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:35.649201 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5266f1b0-58d2-484e-8c6f-c5e68d6206c6 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:35.649861 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5266f1b0-58d2-484e-8c6f-c5e68d6206c6 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:35.658392 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5266f1b0-58d2-484e-8c6f-c5e68d6206c6 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:35.659329 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5266f1b0-58d2-484e-8c6f-c5e68d6206c6 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:35.660398 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5266f1b0-58d2-484e-8c6f-c5e68d6206c6 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:35.661092 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5266f1b0-58d2-484e-8c6f-c5e68d6206c6 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:36.113427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5266f1b0-58d2-484e-8c6f-c5e68d6206c6 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:36.132218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5266f1b0-58d2-484e-8c6f-c5e68d6206c6 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.486830 Feb 10 03:37:36.145575 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 28/55] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:35 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:36.153229 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:36.154177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:36.167078 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:36.168957 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:36.172770 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:36.173483 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:36.289363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:37:36.291237 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:37:36.294961 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:37:36.295771 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:37:36.296968 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:37:36.315232 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:36.315982 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:36.317083 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:36.317786 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:36.348190 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:37:36.362349 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for user fc1ef6f6170f4ccb9e3b439ac3fd56e0 and project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:37:36.397442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:37:36.400021 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:37:36.472059 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-8b956253-e827-4b8f-b342-b1eae381ea7c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.329444 Feb 10 03:37:36.477936 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 28/56] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:37:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:37:36.482727 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1adc9d6d-788c-4ce1-9246-64a748ced39e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:36.483343 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1adc9d6d-788c-4ce1-9246-64a748ced39e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:36.490160 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1adc9d6d-788c-4ce1-9246-64a748ced39e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:36.490898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1adc9d6d-788c-4ce1-9246-64a748ced39e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:36.491890 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1adc9d6d-788c-4ce1-9246-64a748ced39e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:36.492480 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1adc9d6d-788c-4ce1-9246-64a748ced39e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:36.741650 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:36.755741 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:36.759855 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:36.761019 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b0e342c1-4c0b-49ba-ac96-68c7d1022d78 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.613271 Feb 10 03:37:36.765664 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 29/57] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:36 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:36.781387 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8f4135f1-e926-47f8-8c82-544d2626c904 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:36.782070 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8f4135f1-e926-47f8-8c82-544d2626c904 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:36.908876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8f4135f1-e926-47f8-8c82-544d2626c904 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:36.922213 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8f4135f1-e926-47f8-8c82-544d2626c904 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1237 microversion: 2.1 time: 0.152881 Feb 10 03:37:36.939311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 30/58] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:36 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1237 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:37.027632 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1adc9d6d-788c-4ce1-9246-64a748ced39e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:37.045552 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1adc9d6d-788c-4ce1-9246-64a748ced39e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.566416 Feb 10 03:37:37.046157 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 29/59] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:36 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:37.161330 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-cf16507c-56c6-4d75-ac90-4b79562cb30d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:37.162577 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-cf16507c-56c6-4d75-ac90-4b79562cb30d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:37.169354 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf16507c-56c6-4d75-ac90-4b79562cb30d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:37.169812 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf16507c-56c6-4d75-ac90-4b79562cb30d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:37.170944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf16507c-56c6-4d75-ac90-4b79562cb30d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:37.171455 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf16507c-56c6-4d75-ac90-4b79562cb30d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:37.620037 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-cf16507c-56c6-4d75-ac90-4b79562cb30d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:37.632862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-cf16507c-56c6-4d75-ac90-4b79562cb30d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.483208 Feb 10 03:37:37.643363 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 31/60] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:37 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:37.781104 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:37.781756 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:37.793000 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:37.794595 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:37.797072 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:37.797542 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:37.939403 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-10bcec54-6ec5-4301-8df6-a7cbd55a5794 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:37.940020 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-10bcec54-6ec5-4301-8df6-a7cbd55a5794 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:37.949339 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-10bcec54-6ec5-4301-8df6-a7cbd55a5794 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:37.950043 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-10bcec54-6ec5-4301-8df6-a7cbd55a5794 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:37.951534 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-10bcec54-6ec5-4301-8df6-a7cbd55a5794 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:37.953841 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-10bcec54-6ec5-4301-8df6-a7cbd55a5794 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:38.124489 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-10bcec54-6ec5-4301-8df6-a7cbd55a5794 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:38.132921 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-10bcec54-6ec5-4301-8df6-a7cbd55a5794 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1241 microversion: 2.1 time: 0.197066 Feb 10 03:37:38.134207 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 32/61] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:37 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1241 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:38.142330 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b7ed4dc9-8bec-4a72-b11f-c7f72ae0061c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:38.144156 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b7ed4dc9-8bec-4a72-b11f-c7f72ae0061c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:38.156745 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b7ed4dc9-8bec-4a72-b11f-c7f72ae0061c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:38.158591 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b7ed4dc9-8bec-4a72-b11f-c7f72ae0061c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:38.164786 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b7ed4dc9-8bec-4a72-b11f-c7f72ae0061c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:38.165971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b7ed4dc9-8bec-4a72-b11f-c7f72ae0061c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:38.198211 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:38.208026 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:38.213095 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:38.216690 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-81ad6a63-9763-43b7-8a04-3e154ec747c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.440375 Feb 10 03:37:38.220312 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 30/62] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:37 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:38.225128 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-62fd48b7-3e04-422c-b90b-fa49b8171d6b req-f14b2f0a-1787-434a-9950-ebc55f8cbe0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d302b3d4-6282-4fbe-a4c4-248881ee8f51", "tag": "29a0a5b3-6729-4753-8ce5-55f51a8c9a2e"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:38.229352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:38.229352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:37:38.238150 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-62fd48b7-3e04-422c-b90b-fa49b8171d6b req-f14b2f0a-1787-434a-9950-ebc55f8cbe0e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:38.238742 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-62fd48b7-3e04-422c-b90b-fa49b8171d6b req-f14b2f0a-1787-434a-9950-ebc55f8cbe0e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:38.253327 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-62fd48b7-3e04-422c-b90b-fa49b8171d6b req-f14b2f0a-1787-434a-9950-ebc55f8cbe0e service nova] Creating event network-changed:29a0a5b3-6729-4753-8ce5-55f51a8c9a2e for instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 on hv-cinder-82806 Feb 10 03:37:38.265356 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-62fd48b7-3e04-422c-b90b-fa49b8171d6b req-f14b2f0a-1787-434a-9950-ebc55f8cbe0e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043090 Feb 10 03:37:38.266424 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 31/63] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:38.356868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b7ed4dc9-8bec-4a72-b11f-c7f72ae0061c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:38.366893 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b7ed4dc9-8bec-4a72-b11f-c7f72ae0061c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.230406 Feb 10 03:37:38.367593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 33/64] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:38 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:38.655378 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-eab84d87-3577-46e8-9a02-2e79a01fc2df tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:38.656498 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-eab84d87-3577-46e8-9a02-2e79a01fc2df tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:38.662954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eab84d87-3577-46e8-9a02-2e79a01fc2df tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:38.663465 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eab84d87-3577-46e8-9a02-2e79a01fc2df tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:38.664957 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eab84d87-3577-46e8-9a02-2e79a01fc2df tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:38.665482 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eab84d87-3577-46e8-9a02-2e79a01fc2df tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:38.890692 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-eab84d87-3577-46e8-9a02-2e79a01fc2df tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:38.899813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-eab84d87-3577-46e8-9a02-2e79a01fc2df tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.249972 Feb 10 03:37:38.900586 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 32/65] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:38 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:39.154529 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-96a59d3f-92af-47f1-b3dc-1b4219426942 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:39.155419 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-96a59d3f-92af-47f1-b3dc-1b4219426942 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:39.162473 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-96a59d3f-92af-47f1-b3dc-1b4219426942 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:39.164402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-96a59d3f-92af-47f1-b3dc-1b4219426942 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:39.165393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-96a59d3f-92af-47f1-b3dc-1b4219426942 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:39.166240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-96a59d3f-92af-47f1-b3dc-1b4219426942 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:39.238965 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:39.239917 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:39.242294 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-96a59d3f-92af-47f1-b3dc-1b4219426942 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:39.248266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:39.248970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:39.250064 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:39.250644 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:39.255588 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-96a59d3f-92af-47f1-b3dc-1b4219426942 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1233 microversion: 2.1 time: 0.106208 Feb 10 03:37:39.257484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 34/66] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:39 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1233 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:39.384867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a8ebabc4-79f1-42bd-a608-e3a2ed5e7fe5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:39.386897 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a8ebabc4-79f1-42bd-a608-e3a2ed5e7fe5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:39.402560 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a8ebabc4-79f1-42bd-a608-e3a2ed5e7fe5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:39.403305 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a8ebabc4-79f1-42bd-a608-e3a2ed5e7fe5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:39.404263 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a8ebabc4-79f1-42bd-a608-e3a2ed5e7fe5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:39.404838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a8ebabc4-79f1-42bd-a608-e3a2ed5e7fe5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:39.604619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:39.614303 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:39.616120 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:39.617451 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d1e4a60f-e967-46e1-92b3-67be27cdd66f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.383519 Feb 10 03:37:39.627511 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 33/67] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:39 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:37:39.644213 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a8ebabc4-79f1-42bd-a608-e3a2ed5e7fe5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:39.653967 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a8ebabc4-79f1-42bd-a608-e3a2ed5e7fe5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.271194 Feb 10 03:37:39.661524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 35/68] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:39 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:39.917674 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-53c0dbd8-8bd7-4ec5-8a62-923c2969bdf4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:39.918816 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-53c0dbd8-8bd7-4ec5-8a62-923c2969bdf4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:39.925905 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-53c0dbd8-8bd7-4ec5-8a62-923c2969bdf4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:39.926348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-53c0dbd8-8bd7-4ec5-8a62-923c2969bdf4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:39.927402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-53c0dbd8-8bd7-4ec5-8a62-923c2969bdf4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:39.928735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-53c0dbd8-8bd7-4ec5-8a62-923c2969bdf4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:40.117142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-53c0dbd8-8bd7-4ec5-8a62-923c2969bdf4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:40.125111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-53c0dbd8-8bd7-4ec5-8a62-923c2969bdf4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.211937 Feb 10 03:37:40.126198 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 34/69] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:39 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:40.273029 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-062faf86-a54f-4682-86b2-ede5c5493ebb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:40.274317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-062faf86-a54f-4682-86b2-ede5c5493ebb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:40.292044 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-062faf86-a54f-4682-86b2-ede5c5493ebb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:40.292439 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-062faf86-a54f-4682-86b2-ede5c5493ebb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:40.293274 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-062faf86-a54f-4682-86b2-ede5c5493ebb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:40.293707 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-062faf86-a54f-4682-86b2-ede5c5493ebb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:40.393724 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-062faf86-a54f-4682-86b2-ede5c5493ebb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:40.403124 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-062faf86-a54f-4682-86b2-ede5c5493ebb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1289 microversion: 2.1 time: 0.134341 Feb 10 03:37:40.403809 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 36/70] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:40 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1289 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:40.637333 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:40.638269 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:40.645110 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:40.645551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:40.646334 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:40.646804 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:40.668958 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-42b087ca-3d7a-4317-abef-58449b06effb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:40.670615 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-42b087ca-3d7a-4317-abef-58449b06effb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:40.678316 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-42b087ca-3d7a-4317-abef-58449b06effb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:40.679063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-42b087ca-3d7a-4317-abef-58449b06effb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:40.680049 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-42b087ca-3d7a-4317-abef-58449b06effb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:40.680556 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-42b087ca-3d7a-4317-abef-58449b06effb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:40.838802 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:40.847213 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:40.848770 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:40.849880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-12dd6b6d-c999-4852-bc74-aaca7fbaff93 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.216827 Feb 10 03:37:40.850540 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 35/71] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:40 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:40.861527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-42b087ca-3d7a-4317-abef-58449b06effb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:40.873123 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-42b087ca-3d7a-4317-abef-58449b06effb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.207659 Feb 10 03:37:40.873916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 37/72] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:40 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:41.142442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fc7f2143-a625-497b-bb22-9c5fd0641520 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:41.143057 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fc7f2143-a625-497b-bb22-9c5fd0641520 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:41.149836 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fc7f2143-a625-497b-bb22-9c5fd0641520 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:41.150288 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fc7f2143-a625-497b-bb22-9c5fd0641520 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:41.151107 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fc7f2143-a625-497b-bb22-9c5fd0641520 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:41.151544 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fc7f2143-a625-497b-bb22-9c5fd0641520 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:41.292368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fc7f2143-a625-497b-bb22-9c5fd0641520 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:41.303209 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fc7f2143-a625-497b-bb22-9c5fd0641520 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.164193 Feb 10 03:37:41.304012 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 36/73] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:41 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:41.420966 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f7e5dd1e-bde4-4add-ae03-74d852b77c48 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:41.421536 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f7e5dd1e-bde4-4add-ae03-74d852b77c48 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:41.428444 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7e5dd1e-bde4-4add-ae03-74d852b77c48 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:41.429048 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7e5dd1e-bde4-4add-ae03-74d852b77c48 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:41.429816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7e5dd1e-bde4-4add-ae03-74d852b77c48 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:41.430246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7e5dd1e-bde4-4add-ae03-74d852b77c48 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:41.503570 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f7e5dd1e-bde4-4add-ae03-74d852b77c48 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:41.511450 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f7e5dd1e-bde4-4add-ae03-74d852b77c48 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1289 microversion: 2.1 time: 0.094805 Feb 10 03:37:41.511985 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 38/74] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:41 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:41.869929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:41.870535 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:41.877551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:41.878007 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:41.878835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:41.879272 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:41.889195 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-16a65c6a-9922-4f1f-9ac9-598e9c3fb323 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:41.889835 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-16a65c6a-9922-4f1f-9ac9-598e9c3fb323 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:41.896198 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-16a65c6a-9922-4f1f-9ac9-598e9c3fb323 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:41.896640 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-16a65c6a-9922-4f1f-9ac9-598e9c3fb323 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:41.897436 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-16a65c6a-9922-4f1f-9ac9-598e9c3fb323 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:41.897863 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-16a65c6a-9922-4f1f-9ac9-598e9c3fb323 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:42.077553 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:42.088327 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:42.090357 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:42.093674 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-16a65c6a-9922-4f1f-9ac9-598e9c3fb323 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:42.097733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e9b5cd06-b23e-498c-a24d-3438791c49c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.232833 Feb 10 03:37:42.098307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 37/75] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:41 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:42.106519 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-16a65c6a-9922-4f1f-9ac9-598e9c3fb323 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.220038 Feb 10 03:37:42.107320 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 39/76] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:41 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:42.319630 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-12221001-0e91-486d-99b3-6f8120b7c68d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:42.320239 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-12221001-0e91-486d-99b3-6f8120b7c68d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:42.328883 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12221001-0e91-486d-99b3-6f8120b7c68d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:42.329496 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12221001-0e91-486d-99b3-6f8120b7c68d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:42.330277 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12221001-0e91-486d-99b3-6f8120b7c68d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:42.330924 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12221001-0e91-486d-99b3-6f8120b7c68d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:42.528503 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d821d851-53ad-4422-b66e-40f4cb1d8fdf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:42.529041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d821d851-53ad-4422-b66e-40f4cb1d8fdf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:42.535533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d821d851-53ad-4422-b66e-40f4cb1d8fdf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:42.536001 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d821d851-53ad-4422-b66e-40f4cb1d8fdf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:42.536815 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d821d851-53ad-4422-b66e-40f4cb1d8fdf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:42.537197 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d821d851-53ad-4422-b66e-40f4cb1d8fdf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:42.555076 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-12221001-0e91-486d-99b3-6f8120b7c68d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:42.563092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-12221001-0e91-486d-99b3-6f8120b7c68d tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.247361 Feb 10 03:37:42.563913 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 38/77] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:42 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:42.810412 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d821d851-53ad-4422-b66e-40f4cb1d8fdf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:42.818707 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d821d851-53ad-4422-b66e-40f4cb1d8fdf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1295 microversion: 2.1 time: 0.293934 Feb 10 03:37:42.819257 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 40/78] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:42 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1295 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:43.115387 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:43.115997 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:43.123255 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.123556 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:43.124408 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.124767 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:43.125629 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c6ffc444-d14e-4205-9ad9-aacd4232bf7b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:43.126678 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c6ffc444-d14e-4205-9ad9-aacd4232bf7b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:43.136166 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6ffc444-d14e-4205-9ad9-aacd4232bf7b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.136848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6ffc444-d14e-4205-9ad9-aacd4232bf7b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:43.141082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6ffc444-d14e-4205-9ad9-aacd4232bf7b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.141784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6ffc444-d14e-4205-9ad9-aacd4232bf7b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:43.350107 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:43.359724 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:43.361438 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:43.362763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-183be38a-5e8e-46f2-adf4-152294f076e9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.251230 Feb 10 03:37:43.363453 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 39/79] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:43 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:43.368873 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c6ffc444-d14e-4205-9ad9-aacd4232bf7b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:43.376784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c6ffc444-d14e-4205-9ad9-aacd4232bf7b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.256978 Feb 10 03:37:43.377354 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 41/80] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:43 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:43.580437 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c2e7b943-83b1-482c-80b5-88432e794fe4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:43.581040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c2e7b943-83b1-482c-80b5-88432e794fe4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:43.587731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c2e7b943-83b1-482c-80b5-88432e794fe4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.588251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c2e7b943-83b1-482c-80b5-88432e794fe4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:43.589107 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c2e7b943-83b1-482c-80b5-88432e794fe4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.589641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c2e7b943-83b1-482c-80b5-88432e794fe4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:43.801606 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c2e7b943-83b1-482c-80b5-88432e794fe4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:43.812002 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c2e7b943-83b1-482c-80b5-88432e794fe4 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.235235 Feb 10 03:37:43.812582 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 40/81] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:43 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:43.839842 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dd7ab36d-82b4-4ebd-8e86-5cf84ab0b54e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:43.840458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dd7ab36d-82b4-4ebd-8e86-5cf84ab0b54e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:43.858403 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd7ab36d-82b4-4ebd-8e86-5cf84ab0b54e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.862578 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd7ab36d-82b4-4ebd-8e86-5cf84ab0b54e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:43.863458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd7ab36d-82b4-4ebd-8e86-5cf84ab0b54e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.863889 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd7ab36d-82b4-4ebd-8e86-5cf84ab0b54e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:43.953623 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-6aa6f3f8-d3c1-4f9a-bcd1-03a35126c9fc req-f2176cec-1998-4797-9985-6e3138e1d7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60b46a9-24cb-430f-83bd-3c74a87a08cd", "tag": "2f6a5eaa-729c-49cc-aff5-a2c491acd54d"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:43.957107 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:43.957107 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:37:43.974747 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-6aa6f3f8-d3c1-4f9a-bcd1-03a35126c9fc req-f2176cec-1998-4797-9985-6e3138e1d7e3 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:43.975446 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-6aa6f3f8-d3c1-4f9a-bcd1-03a35126c9fc req-f2176cec-1998-4797-9985-6e3138e1d7e3 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:44.021995 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-6aa6f3f8-d3c1-4f9a-bcd1-03a35126c9fc req-f2176cec-1998-4797-9985-6e3138e1d7e3 service nova] Creating event network-changed:2f6a5eaa-729c-49cc-aff5-a2c491acd54d for instance d60b46a9-24cb-430f-83bd-3c74a87a08cd on hv-cinder-82806 Feb 10 03:37:44.058318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-6aa6f3f8-d3c1-4f9a-bcd1-03a35126c9fc req-f2176cec-1998-4797-9985-6e3138e1d7e3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106978 Feb 10 03:37:44.059028 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 41/82] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:37:44.179073 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dd7ab36d-82b4-4ebd-8e86-5cf84ab0b54e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:44.199201 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dd7ab36d-82b4-4ebd-8e86-5cf84ab0b54e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.366278 Feb 10 03:37:44.216729 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 42/83] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:43 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:44.382703 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:44.383771 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:44.394768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5e5cde94-81b5-419b-b1f8-bbe6548e0d27 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:44.395577 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5e5cde94-81b5-419b-b1f8-bbe6548e0d27 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:44.405131 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5e5cde94-81b5-419b-b1f8-bbe6548e0d27 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:44.411776 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5e5cde94-81b5-419b-b1f8-bbe6548e0d27 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:44.412702 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5e5cde94-81b5-419b-b1f8-bbe6548e0d27 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:44.415240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5e5cde94-81b5-419b-b1f8-bbe6548e0d27 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:44.416573 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:44.419790 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:44.420820 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:44.422993 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:44.695088 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5e5cde94-81b5-419b-b1f8-bbe6548e0d27 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:44.703309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5e5cde94-81b5-419b-b1f8-bbe6548e0d27 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.313372 Feb 10 03:37:44.704160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 43/84] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:44 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:44.718909 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:44.728562 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:44.731527 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:44.732990 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b96d2c0c-ffa0-451a-b1f3-c1c37f0f4440 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.354796 Feb 10 03:37:44.733758 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 42/85] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:44 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:44.768528 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-6e602efd-c957-47ad-800a-fc7763f8705f req-8a2afd1f-b9a4-44de-81d4-bef5544c1242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28168573-b016-4c85-a32c-158c4155cd28", "name": "network-vif-plugged", "status": "completed", "tag": "beb068b9-e15c-4f4f-92d7-1c14f685b47d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:44.770142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:44.770142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:37:44.777185 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-6e602efd-c957-47ad-800a-fc7763f8705f req-8a2afd1f-b9a4-44de-81d4-bef5544c1242 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:44.777628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-6e602efd-c957-47ad-800a-fc7763f8705f req-8a2afd1f-b9a4-44de-81d4-bef5544c1242 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:44.788748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-6e602efd-c957-47ad-800a-fc7763f8705f req-8a2afd1f-b9a4-44de-81d4-bef5544c1242 service nova] Creating event network-vif-plugged:beb068b9-e15c-4f4f-92d7-1c14f685b47d for instance 28168573-b016-4c85-a32c-158c4155cd28 on hv-cinder-82806 Feb 10 03:37:44.794042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-6e602efd-c957-47ad-800a-fc7763f8705f req-8a2afd1f-b9a4-44de-81d4-bef5544c1242 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088644 Feb 10 03:37:44.794669 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 44/86] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:44.829615 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-071957bb-68cd-4903-bb4b-006df760de1c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:44.830227 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-071957bb-68cd-4903-bb4b-006df760de1c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:44.836564 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-071957bb-68cd-4903-bb4b-006df760de1c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:44.837022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-071957bb-68cd-4903-bb4b-006df760de1c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:44.837801 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-071957bb-68cd-4903-bb4b-006df760de1c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:44.838240 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-071957bb-68cd-4903-bb4b-006df760de1c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:44.980907 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-071957bb-68cd-4903-bb4b-006df760de1c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:44.991974 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-071957bb-68cd-4903-bb4b-006df760de1c tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.165864 Feb 10 03:37:44.992899 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 43/87] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:44 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:45.222448 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-099569a1-9df8-4006-9ec8-6bb823289b50 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:45.223335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-099569a1-9df8-4006-9ec8-6bb823289b50 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:45.231391 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-099569a1-9df8-4006-9ec8-6bb823289b50 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:45.231870 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-099569a1-9df8-4006-9ec8-6bb823289b50 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:45.232663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-099569a1-9df8-4006-9ec8-6bb823289b50 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:45.233098 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-099569a1-9df8-4006-9ec8-6bb823289b50 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:45.371491 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-099569a1-9df8-4006-9ec8-6bb823289b50 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:45.379479 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-099569a1-9df8-4006-9ec8-6bb823289b50 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.162719 Feb 10 03:37:45.380041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 45/88] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:45 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:45.720625 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0e4738f9-1600-47af-8ffc-b6814d66e082 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:45.721280 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0e4738f9-1600-47af-8ffc-b6814d66e082 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:45.727546 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0e4738f9-1600-47af-8ffc-b6814d66e082 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:45.728000 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0e4738f9-1600-47af-8ffc-b6814d66e082 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:45.728793 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0e4738f9-1600-47af-8ffc-b6814d66e082 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:45.729229 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0e4738f9-1600-47af-8ffc-b6814d66e082 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:45.751844 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:45.752802 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:45.762335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:45.762816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:45.763573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:45.764001 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:45.917737 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0e4738f9-1600-47af-8ffc-b6814d66e082 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:45.925649 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0e4738f9-1600-47af-8ffc-b6814d66e082 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.208829 Feb 10 03:37:45.926237 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 44/89] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:45 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:45.949595 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:45.959540 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:45.961084 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:45.962183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-af36e295-cad9-4b75-9929-ca15f58119be tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.214630 Feb 10 03:37:45.962763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 46/90] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:45 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:46.014226 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9bc5d233-c930-499c-81f6-5ffd294c1e29 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:46.014938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9bc5d233-c930-499c-81f6-5ffd294c1e29 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:46.023270 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9bc5d233-c930-499c-81f6-5ffd294c1e29 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.023777 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9bc5d233-c930-499c-81f6-5ffd294c1e29 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:46.024735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9bc5d233-c930-499c-81f6-5ffd294c1e29 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.025257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9bc5d233-c930-499c-81f6-5ffd294c1e29 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:46.166225 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-9bc5d233-c930-499c-81f6-5ffd294c1e29 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:46.174286 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9bc5d233-c930-499c-81f6-5ffd294c1e29 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.164542 Feb 10 03:37:46.174896 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 45/91] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:46 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:46.396325 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4f33ca41-052f-4ea8-bbf5-5da0b1dc75af tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:46.396937 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4f33ca41-052f-4ea8-bbf5-5da0b1dc75af tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:46.403212 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4f33ca41-052f-4ea8-bbf5-5da0b1dc75af tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.403667 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4f33ca41-052f-4ea8-bbf5-5da0b1dc75af tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:46.404449 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4f33ca41-052f-4ea8-bbf5-5da0b1dc75af tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.404893 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4f33ca41-052f-4ea8-bbf5-5da0b1dc75af tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:46.559501 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4f33ca41-052f-4ea8-bbf5-5da0b1dc75af tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:46.567658 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4f33ca41-052f-4ea8-bbf5-5da0b1dc75af tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.174952 Feb 10 03:37:46.568400 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 47/92] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:46 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:46.808458 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-da34025b-2c93-4514-8f1f-bec9144d18c4 req-ee121540-707a-4aed-9d67-9d8ceecf94d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84018c6b-a22d-4280-a1a2-e0f2c315c2ce", "name": "network-vif-plugged", "status": "completed", "tag": "df41c157-7d92-4a0b-b955-e6573b3cc8f2"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:46.810079 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:46.810079 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:37:46.817022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-da34025b-2c93-4514-8f1f-bec9144d18c4 req-ee121540-707a-4aed-9d67-9d8ceecf94d8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.817460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-da34025b-2c93-4514-8f1f-bec9144d18c4 req-ee121540-707a-4aed-9d67-9d8ceecf94d8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:46.828897 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-da34025b-2c93-4514-8f1f-bec9144d18c4 req-ee121540-707a-4aed-9d67-9d8ceecf94d8 service nova] Creating event network-vif-plugged:df41c157-7d92-4a0b-b955-e6573b3cc8f2 for instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce on hv-cinder-82806 Feb 10 03:37:46.833886 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-da34025b-2c93-4514-8f1f-bec9144d18c4 req-ee121540-707a-4aed-9d67-9d8ceecf94d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029051 Feb 10 03:37:46.834472 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 46/93] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:46.946609 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3a02ce47-ef0e-4fd2-8954-2a684477b3d0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:46.947175 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3a02ce47-ef0e-4fd2-8954-2a684477b3d0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:46.953662 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3a02ce47-ef0e-4fd2-8954-2a684477b3d0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.954116 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3a02ce47-ef0e-4fd2-8954-2a684477b3d0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:46.954933 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3a02ce47-ef0e-4fd2-8954-2a684477b3d0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.955365 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3a02ce47-ef0e-4fd2-8954-2a684477b3d0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:46.980735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:46.981415 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:46.988067 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.988513 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:46.989301 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:46.989729 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:47.144266 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3a02ce47-ef0e-4fd2-8954-2a684477b3d0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:47.152516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3a02ce47-ef0e-4fd2-8954-2a684477b3d0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.211436 Feb 10 03:37:47.153436 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 48/94] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:46 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:47.176020 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:47.184293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:47.185844 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:47.186987 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7f30a8f8-38f7-46f8-89ee-e66e7876cb3e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.210407 Feb 10 03:37:47.187565 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 47/95] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:46 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:47.191416 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-9d40a757-ffb1-4153-b607-4df8eb63c183 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:47.192025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9d40a757-ffb1-4153-b607-4df8eb63c183 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:47.198844 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9d40a757-ffb1-4153-b607-4df8eb63c183 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:47.199227 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9d40a757-ffb1-4153-b607-4df8eb63c183 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:47.200037 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9d40a757-ffb1-4153-b607-4df8eb63c183 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:47.200468 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9d40a757-ffb1-4153-b607-4df8eb63c183 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:47.352097 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-9d40a757-ffb1-4153-b607-4df8eb63c183 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:47.362839 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-9d40a757-ffb1-4153-b607-4df8eb63c183 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.174957 Feb 10 03:37:47.375125 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 49/96] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:47 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:47.585392 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e6911379-e572-4459-b969-18ee448ef169 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:47.586184 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e6911379-e572-4459-b969-18ee448ef169 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:47.599241 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6911379-e572-4459-b969-18ee448ef169 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:47.599883 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6911379-e572-4459-b969-18ee448ef169 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:47.600529 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6911379-e572-4459-b969-18ee448ef169 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:47.601433 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6911379-e572-4459-b969-18ee448ef169 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:47.758455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e6911379-e572-4459-b969-18ee448ef169 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:47.768457 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e6911379-e572-4459-b969-18ee448ef169 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.186764 Feb 10 03:37:47.769361 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 48/97] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:47 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:48.169722 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-cf8de602-765c-446b-9739-79812b01e737 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:48.170326 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-cf8de602-765c-446b-9739-79812b01e737 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:48.176825 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf8de602-765c-446b-9739-79812b01e737 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:48.177265 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf8de602-765c-446b-9739-79812b01e737 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:48.177999 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf8de602-765c-446b-9739-79812b01e737 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:48.178460 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf8de602-765c-446b-9739-79812b01e737 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:48.204981 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:48.206243 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:48.212362 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:48.212809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:48.213592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:48.214025 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:48.348700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-cf8de602-765c-446b-9739-79812b01e737 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:48.356482 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-cf8de602-765c-446b-9739-79812b01e737 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.190464 Feb 10 03:37:48.357079 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 50/98] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:48 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:48.383123 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-54c2a7c1-516a-420d-a6ee-25d3acfed804 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:48.383982 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-54c2a7c1-516a-420d-a6ee-25d3acfed804 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:48.389833 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54c2a7c1-516a-420d-a6ee-25d3acfed804 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:48.390284 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54c2a7c1-516a-420d-a6ee-25d3acfed804 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:48.391141 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54c2a7c1-516a-420d-a6ee-25d3acfed804 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:48.391718 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54c2a7c1-516a-420d-a6ee-25d3acfed804 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:48.411021 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:48.419148 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:48.420809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:48.421936 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-58c54fe1-ccd8-4978-91e9-4b6eaa5f9d31 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.220884 Feb 10 03:37:48.422597 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 49/99] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:48 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:48.526559 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-54c2a7c1-516a-420d-a6ee-25d3acfed804 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:48.534303 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-54c2a7c1-516a-420d-a6ee-25d3acfed804 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.155308 Feb 10 03:37:48.534899 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 51/100] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:48 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:48.789501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-66f25b61-0d56-460f-af2d-b2b032ccba72 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:48.790109 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-66f25b61-0d56-460f-af2d-b2b032ccba72 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:48.796644 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-66f25b61-0d56-460f-af2d-b2b032ccba72 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:48.797094 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-66f25b61-0d56-460f-af2d-b2b032ccba72 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:48.797851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-66f25b61-0d56-460f-af2d-b2b032ccba72 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:48.798313 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-66f25b61-0d56-460f-af2d-b2b032ccba72 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:48.942563 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-66f25b61-0d56-460f-af2d-b2b032ccba72 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:48.950364 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-66f25b61-0d56-460f-af2d-b2b032ccba72 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.164608 Feb 10 03:37:48.950985 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 50/101] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:48 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:49.374208 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4a154746-7d84-4ac8-b298-ec1643311240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:49.374823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4a154746-7d84-4ac8-b298-ec1643311240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:49.381302 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4a154746-7d84-4ac8-b298-ec1643311240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:49.381746 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4a154746-7d84-4ac8-b298-ec1643311240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:49.382555 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4a154746-7d84-4ac8-b298-ec1643311240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:49.383103 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4a154746-7d84-4ac8-b298-ec1643311240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:49.446782 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:49.447399 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:49.453707 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:49.454167 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:49.454981 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:49.455419 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:49.546309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4a154746-7d84-4ac8-b298-ec1643311240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:49.554112 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4a154746-7d84-4ac8-b298-ec1643311240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.183928 Feb 10 03:37:49.554757 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 52/102] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:49 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:49.563774 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-fa95e321-9537-4841-a0c4-1c6ee5ac9325 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:49.563774 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-fa95e321-9537-4841-a0c4-1c6ee5ac9325 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:49.566068 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fa95e321-9537-4841-a0c4-1c6ee5ac9325 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:49.566514 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fa95e321-9537-4841-a0c4-1c6ee5ac9325 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:49.567341 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fa95e321-9537-4841-a0c4-1c6ee5ac9325 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:49.567788 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fa95e321-9537-4841-a0c4-1c6ee5ac9325 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:49.656890 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:49.665612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:49.667154 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:49.668266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3082f8fc-898f-4ecf-a7bb-3625a29a9652 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.225311 Feb 10 03:37:49.669043 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 51/103] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:49 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:49.738677 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-fa95e321-9537-4841-a0c4-1c6ee5ac9325 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:49.746481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-fa95e321-9537-4841-a0c4-1c6ee5ac9325 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.190716 Feb 10 03:37:49.747584 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 53/104] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:49 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:49.971642 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1dfa1aae-3f10-4184-bf9e-f323d89977f1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:49.972251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1dfa1aae-3f10-4184-bf9e-f323d89977f1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:49.978709 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1dfa1aae-3f10-4184-bf9e-f323d89977f1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:49.979156 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1dfa1aae-3f10-4184-bf9e-f323d89977f1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:49.979942 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1dfa1aae-3f10-4184-bf9e-f323d89977f1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:49.980351 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1dfa1aae-3f10-4184-bf9e-f323d89977f1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:50.126395 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1dfa1aae-3f10-4184-bf9e-f323d89977f1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:50.138101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1dfa1aae-3f10-4184-bf9e-f323d89977f1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.169924 Feb 10 03:37:50.138721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 52/105] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:49 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:50.572411 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4e2b4fd8-2a73-4e75-8f48-13d5c3b4adb7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:50.573009 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4e2b4fd8-2a73-4e75-8f48-13d5c3b4adb7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:50.581876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4e2b4fd8-2a73-4e75-8f48-13d5c3b4adb7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:50.582505 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4e2b4fd8-2a73-4e75-8f48-13d5c3b4adb7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:50.583478 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4e2b4fd8-2a73-4e75-8f48-13d5c3b4adb7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:50.583980 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4e2b4fd8-2a73-4e75-8f48-13d5c3b4adb7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:50.687201 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:50.688317 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:50.694621 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:50.695361 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:50.696298 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:50.696912 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:50.785447 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4e2b4fd8-2a73-4e75-8f48-13d5c3b4adb7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:50.795895 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4e2b4fd8-2a73-4e75-8f48-13d5c3b4adb7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.226791 Feb 10 03:37:50.797420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 54/106] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:50 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:50.805111 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-57021e05-a331-43bc-a636-114f552a1856 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:50.806105 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-57021e05-a331-43bc-a636-114f552a1856 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:50.816991 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-57021e05-a331-43bc-a636-114f552a1856 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:50.817670 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-57021e05-a331-43bc-a636-114f552a1856 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:50.818215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-57021e05-a331-43bc-a636-114f552a1856 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:50.818753 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-57021e05-a331-43bc-a636-114f552a1856 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:50.875755 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:50.884951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:50.886616 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:50.887853 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-522bd843-37db-4539-832b-5389d1afcfc3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.204756 Feb 10 03:37:50.894721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 53/107] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:50 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:50.969736 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-57021e05-a331-43bc-a636-114f552a1856 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:50.977520 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-57021e05-a331-43bc-a636-114f552a1856 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.178705 Feb 10 03:37:50.978101 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 55/108] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:50 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:51.156726 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-8dea9c51-6cd6-47d6-bd91-889c7aae7218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:51.157427 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8dea9c51-6cd6-47d6-bd91-889c7aae7218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:51.163813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8dea9c51-6cd6-47d6-bd91-889c7aae7218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:51.164333 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8dea9c51-6cd6-47d6-bd91-889c7aae7218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:51.165224 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8dea9c51-6cd6-47d6-bd91-889c7aae7218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:51.165721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8dea9c51-6cd6-47d6-bd91-889c7aae7218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:51.300591 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-8dea9c51-6cd6-47d6-bd91-889c7aae7218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:51.308533 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-8dea9c51-6cd6-47d6-bd91-889c7aae7218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.156599 Feb 10 03:37:51.309111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 54/109] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:51 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:51.813141 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ea2496d4-429f-45dc-8115-b2e1bfed4642 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:51.813747 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ea2496d4-429f-45dc-8115-b2e1bfed4642 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:51.820247 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea2496d4-429f-45dc-8115-b2e1bfed4642 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:51.820689 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea2496d4-429f-45dc-8115-b2e1bfed4642 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:51.821458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea2496d4-429f-45dc-8115-b2e1bfed4642 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:51.821886 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea2496d4-429f-45dc-8115-b2e1bfed4642 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:51.905423 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:51.906324 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:51.912574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:51.913096 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:51.913946 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:51.914449 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:51.970856 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ea2496d4-429f-45dc-8115-b2e1bfed4642 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:51.978847 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ea2496d4-429f-45dc-8115-b2e1bfed4642 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.169215 Feb 10 03:37:51.979423 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 56/110] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:51 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:51.993245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8229133d-e06a-4b05-a45d-66e3021a2e80 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:51.993927 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8229133d-e06a-4b05-a45d-66e3021a2e80 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:52.000892 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8229133d-e06a-4b05-a45d-66e3021a2e80 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:52.001338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8229133d-e06a-4b05-a45d-66e3021a2e80 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:52.002123 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8229133d-e06a-4b05-a45d-66e3021a2e80 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:52.002583 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8229133d-e06a-4b05-a45d-66e3021a2e80 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:52.097249 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:52.105733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:52.107327 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:52.108441 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0630283b-044f-417c-b972-4df0de817282 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.206860 Feb 10 03:37:52.109007 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 55/111] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:51 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:52.165452 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8229133d-e06a-4b05-a45d-66e3021a2e80 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:52.175247 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8229133d-e06a-4b05-a45d-66e3021a2e80 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.185607 Feb 10 03:37:52.175813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 57/112] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:51 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:52.326152 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a7851843-8eaa-4766-8214-0369769bd1ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:52.326857 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a7851843-8eaa-4766-8214-0369769bd1ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:52.334027 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a7851843-8eaa-4766-8214-0369769bd1ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:52.334521 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a7851843-8eaa-4766-8214-0369769bd1ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:52.335415 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a7851843-8eaa-4766-8214-0369769bd1ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:52.335967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a7851843-8eaa-4766-8214-0369769bd1ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:52.479253 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a7851843-8eaa-4766-8214-0369769bd1ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:52.490249 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a7851843-8eaa-4766-8214-0369769bd1ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.167799 Feb 10 03:37:52.491046 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 56/113] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:52 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:52.999921 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c9be7a8f-8bb1-4a30-95bb-7c10980b0a5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:53.000800 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c9be7a8f-8bb1-4a30-95bb-7c10980b0a5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:53.011307 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c9be7a8f-8bb1-4a30-95bb-7c10980b0a5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:53.011761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c9be7a8f-8bb1-4a30-95bb-7c10980b0a5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:53.012546 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c9be7a8f-8bb1-4a30-95bb-7c10980b0a5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:53.012978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c9be7a8f-8bb1-4a30-95bb-7c10980b0a5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:53.126786 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:53.127365 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:53.133356 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:53.133810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:53.134588 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:53.135050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:53.164085 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c9be7a8f-8bb1-4a30-95bb-7c10980b0a5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:53.172148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c9be7a8f-8bb1-4a30-95bb-7c10980b0a5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.178600 Feb 10 03:37:53.172841 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 58/114] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:52 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:53.191963 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-845220fd-07a1-4619-8eda-df564ed9ba1e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:53.192654 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-845220fd-07a1-4619-8eda-df564ed9ba1e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:53.198860 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-845220fd-07a1-4619-8eda-df564ed9ba1e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:53.199460 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-845220fd-07a1-4619-8eda-df564ed9ba1e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:53.200145 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-845220fd-07a1-4619-8eda-df564ed9ba1e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:53.200784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-845220fd-07a1-4619-8eda-df564ed9ba1e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:53.321230 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:53.331141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:53.332894 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:53.334255 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6dc896bc-fdd2-4bd9-a7a7-555f49b11270 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.211294 Feb 10 03:37:53.335123 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 57/115] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:53 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:53.382429 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-845220fd-07a1-4619-8eda-df564ed9ba1e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:53.390619 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-845220fd-07a1-4619-8eda-df564ed9ba1e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.202331 Feb 10 03:37:53.391232 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 59/116] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:53 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:53.510430 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-39113119-1ed3-497a-86b9-5d8ec2f92be4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:53.511235 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-39113119-1ed3-497a-86b9-5d8ec2f92be4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:53.518147 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-39113119-1ed3-497a-86b9-5d8ec2f92be4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:53.518681 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-39113119-1ed3-497a-86b9-5d8ec2f92be4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:53.519501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-39113119-1ed3-497a-86b9-5d8ec2f92be4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:53.519947 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-39113119-1ed3-497a-86b9-5d8ec2f92be4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:53.673294 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-39113119-1ed3-497a-86b9-5d8ec2f92be4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:53.682412 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-39113119-1ed3-497a-86b9-5d8ec2f92be4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.176867 Feb 10 03:37:53.683291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 58/117] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:53 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:54.193885 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-9530abb7-d930-471f-8dc4-fa504cf94f91 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:54.194530 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9530abb7-d930-471f-8dc4-fa504cf94f91 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:54.201064 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9530abb7-d930-471f-8dc4-fa504cf94f91 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:54.201452 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9530abb7-d930-471f-8dc4-fa504cf94f91 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:54.202224 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9530abb7-d930-471f-8dc4-fa504cf94f91 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:54.202884 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9530abb7-d930-471f-8dc4-fa504cf94f91 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:54.352497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:54.353212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:54.359898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:54.360574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:54.362008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:54.362718 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:54.370362 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-9530abb7-d930-471f-8dc4-fa504cf94f91 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:54.381029 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-9530abb7-d930-471f-8dc4-fa504cf94f91 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1318 microversion: 2.1 time: 0.192901 Feb 10 03:37:54.384134 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 60/118] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:54 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:54.408418 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f063b89a-bc6d-4e04-bafa-6c25c511d834 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:54.409887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f063b89a-bc6d-4e04-bafa-6c25c511d834 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:54.418645 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f063b89a-bc6d-4e04-bafa-6c25c511d834 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:54.419750 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f063b89a-bc6d-4e04-bafa-6c25c511d834 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:54.421692 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f063b89a-bc6d-4e04-bafa-6c25c511d834 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:54.422344 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f063b89a-bc6d-4e04-bafa-6c25c511d834 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:54.598258 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:54.606771 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:54.608291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:54.609419 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-500832de-b94b-4d4f-b8d2-d6d6c158967b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.261135 Feb 10 03:37:54.609983 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 59/119] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:54 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:37:54.627321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f063b89a-bc6d-4e04-bafa-6c25c511d834 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:54.635161 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f063b89a-bc6d-4e04-bafa-6c25c511d834 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1315 microversion: 2.1 time: 0.231022 Feb 10 03:37:54.636381 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 61/120] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:54 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:54.699196 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4c9eae41-c468-433e-a56b-1b0781abe0ca tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:54.699742 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4c9eae41-c468-433e-a56b-1b0781abe0ca tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:54.707158 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4c9eae41-c468-433e-a56b-1b0781abe0ca tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:54.707609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4c9eae41-c468-433e-a56b-1b0781abe0ca tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:54.708393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4c9eae41-c468-433e-a56b-1b0781abe0ca tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:54.708933 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4c9eae41-c468-433e-a56b-1b0781abe0ca tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:54.855996 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4c9eae41-c468-433e-a56b-1b0781abe0ca tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:54.863638 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4c9eae41-c468-433e-a56b-1b0781abe0ca tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.168252 Feb 10 03:37:54.864290 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 60/121] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:54 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:55.402685 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-54dbd10c-2b41-4f12-9727-5a41e7478fa8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:55.407575 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-54dbd10c-2b41-4f12-9727-5a41e7478fa8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:55.432692 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54dbd10c-2b41-4f12-9727-5a41e7478fa8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:55.433312 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54dbd10c-2b41-4f12-9727-5a41e7478fa8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:55.434473 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54dbd10c-2b41-4f12-9727-5a41e7478fa8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:55.435170 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54dbd10c-2b41-4f12-9727-5a41e7478fa8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:55.627970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:55.629489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:55.640900 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:55.642597 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:55.644639 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:55.646047 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:55.696758 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-54dbd10c-2b41-4f12-9727-5a41e7478fa8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:55.707764 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-54dbd10c-2b41-4f12-9727-5a41e7478fa8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1507 microversion: 2.1 time: 0.312039 Feb 10 03:37:55.708718 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 62/122] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:55 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:55.715655 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8a704926-d7b9-4eed-8239-acf933d81a1a tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:55.716568 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8a704926-d7b9-4eed-8239-acf933d81a1a tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:55.723988 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a704926-d7b9-4eed-8239-acf933d81a1a tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:55.724742 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a704926-d7b9-4eed-8239-acf933d81a1a tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:55.725706 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a704926-d7b9-4eed-8239-acf933d81a1a tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:55.726331 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a704926-d7b9-4eed-8239-acf933d81a1a tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:55.978930 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8a704926-d7b9-4eed-8239-acf933d81a1a tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:55.988237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8a704926-d7b9-4eed-8239-acf933d81a1a tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1503 microversion: 2.1 time: 0.277654 Feb 10 03:37:55.988818 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 63/123] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:55 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:56.000673 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8950d124-94a5-4bff-b943-64cc3bcc7780 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:56.001610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8950d124-94a5-4bff-b943-64cc3bcc7780 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:56.011165 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8950d124-94a5-4bff-b943-64cc3bcc7780 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:56.011935 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8950d124-94a5-4bff-b943-64cc3bcc7780 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:56.013337 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8950d124-94a5-4bff-b943-64cc3bcc7780 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:56.014001 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8950d124-94a5-4bff-b943-64cc3bcc7780 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:56.113904 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:56.127598 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:56.136395 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:56.148875 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-80d51e88-d233-4306-8489-1c228accec9d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.517220 Feb 10 03:37:56.153655 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 61/124] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:55 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:37:56.175093 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-23605c6f-e707-4392-b897-88691f8f25c8 req-b016fc57-c5b6-4726-8e70-2431f5a98c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d302b3d4-6282-4fbe-a4c4-248881ee8f51", "name": "network-vif-plugged", "status": "completed", "tag": "29a0a5b3-6729-4753-8ce5-55f51a8c9a2e"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:56.183042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:56.183042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:37:56.220763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-23605c6f-e707-4392-b897-88691f8f25c8 req-b016fc57-c5b6-4726-8e70-2431f5a98c24 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:56.221358 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-23605c6f-e707-4392-b897-88691f8f25c8 req-b016fc57-c5b6-4726-8e70-2431f5a98c24 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:56.245443 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-23605c6f-e707-4392-b897-88691f8f25c8 req-b016fc57-c5b6-4726-8e70-2431f5a98c24 service nova] Creating event network-vif-plugged:29a0a5b3-6729-4753-8ce5-55f51a8c9a2e for instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 on hv-cinder-82806 Feb 10 03:37:56.262363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-23605c6f-e707-4392-b897-88691f8f25c8 req-b016fc57-c5b6-4726-8e70-2431f5a98c24 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107148 Feb 10 03:37:56.263353 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 62/125] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:56.350061 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8950d124-94a5-4bff-b943-64cc3bcc7780 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:56.370643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8950d124-94a5-4bff-b943-64cc3bcc7780 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.371937 Feb 10 03:37:56.372032 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 64/126] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:55 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:57.184831 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:57.185525 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:57.201618 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:57.202234 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:57.203075 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:57.203522 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:57.374301 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:57.390203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:57.391855 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:57.392970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-09009aa5-d6b9-447a-8606-f7edcea6899d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1405 microversion: 2.20 time: 0.218960 Feb 10 03:37:57.393524 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 63/127] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:57 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:37:57.397761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4aae8e15-b956-4277-bb77-2bea6be1d9d5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:57.398440 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4aae8e15-b956-4277-bb77-2bea6be1d9d5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:57.407605 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4aae8e15-b956-4277-bb77-2bea6be1d9d5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:57.408081 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4aae8e15-b956-4277-bb77-2bea6be1d9d5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:57.408867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4aae8e15-b956-4277-bb77-2bea6be1d9d5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:57.409293 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4aae8e15-b956-4277-bb77-2bea6be1d9d5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:57.563902 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-72827c16-d43d-4441-b6fc-ed9312f40301 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53bced8e-be60-480b-9ddd-b0a6cfb3fe19"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:57.565167 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-72827c16-d43d-4441-b6fc-ed9312f40301 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:57.584485 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72827c16-d43d-4441-b6fc-ed9312f40301 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:57.585348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72827c16-d43d-4441-b6fc-ed9312f40301 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:57.588808 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72827c16-d43d-4441-b6fc-ed9312f40301 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:57.589267 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72827c16-d43d-4441-b6fc-ed9312f40301 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:57.592745 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4aae8e15-b956-4277-bb77-2bea6be1d9d5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:57.606848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4aae8e15-b956-4277-bb77-2bea6be1d9d5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.211416 Feb 10 03:37:57.606848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 65/128] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:57 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:37:57.616583 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b16c4f27-8022-4770-ad15-d0c343caa50e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c7f17be-7c5f-4f8b-a113-52756c07040a"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:57.617962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b16c4f27-8022-4770-ad15-d0c343caa50e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:57.628880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b16c4f27-8022-4770-ad15-d0c343caa50e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:57.629419 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b16c4f27-8022-4770-ad15-d0c343caa50e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:57.630349 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b16c4f27-8022-4770-ad15-d0c343caa50e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:57.630877 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b16c4f27-8022-4770-ad15-d0c343caa50e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:58.246363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-72827c16-d43d-4441-b6fc-ed9312f40301 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.686386 Feb 10 03:37:58.247372 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 64/129] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:37:57 2022] POST /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments => generated 194 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:37:58.291672 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-6a69e075-c1d6-469e-8570-f0159c99040d req-24477a27-15d9-496f-9262-7217da3a33bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60b46a9-24cb-430f-83bd-3c74a87a08cd", "name": "network-vif-plugged", "status": "completed", "tag": "2f6a5eaa-729c-49cc-aff5-a2c491acd54d"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:37:58.293234 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:37:58.293234 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:37:58.301861 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-6a69e075-c1d6-469e-8570-f0159c99040d req-24477a27-15d9-496f-9262-7217da3a33bc service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:58.302879 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-6a69e075-c1d6-469e-8570-f0159c99040d req-24477a27-15d9-496f-9262-7217da3a33bc service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:58.315515 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-6a69e075-c1d6-469e-8570-f0159c99040d req-24477a27-15d9-496f-9262-7217da3a33bc service nova] Creating event network-vif-plugged:2f6a5eaa-729c-49cc-aff5-a2c491acd54d for instance d60b46a9-24cb-430f-83bd-3c74a87a08cd on hv-cinder-82806 Feb 10 03:37:58.320704 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-6a69e075-c1d6-469e-8570-f0159c99040d req-24477a27-15d9-496f-9262-7217da3a33bc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033148 Feb 10 03:37:58.321686 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 65/130] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:58.395020 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b16c4f27-8022-4770-ad15-d0c343caa50e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "POST /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781949 Feb 10 03:37:58.395628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 66/131] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:37:57 2022] POST /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:37:58.412185 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:58.412901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:58.419394 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:58.420085 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:58.421447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:58.422072 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:58.604906 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:58.613998 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:58.616292 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:58.617687 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1425dcd8-0f7b-4c53-b125-a0a138b007ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1597 microversion: 2.20 time: 0.210099 Feb 10 03:37:58.618564 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 66/132] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:37:58 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1597 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:37:58.621268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5b05f830-da20-4cd9-aeaa-ea81676d8960 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:58.622557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5b05f830-da20-4cd9-aeaa-ea81676d8960 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:58.629763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b05f830-da20-4cd9-aeaa-ea81676d8960 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:58.630498 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b05f830-da20-4cd9-aeaa-ea81676d8960 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:58.631607 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b05f830-da20-4cd9-aeaa-ea81676d8960 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:58.632105 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b05f830-da20-4cd9-aeaa-ea81676d8960 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:58.636552 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-501071f9-e3c5-422f-a93e-5c749ff53014 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:58.637294 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-501071f9-e3c5-422f-a93e-5c749ff53014 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:58.647904 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-501071f9-e3c5-422f-a93e-5c749ff53014 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:58.648189 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-501071f9-e3c5-422f-a93e-5c749ff53014 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:58.649498 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-501071f9-e3c5-422f-a93e-5c749ff53014 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:58.650111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-501071f9-e3c5-422f-a93e-5c749ff53014 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:58.768940 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-501071f9-e3c5-422f-a93e-5c749ff53014 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.136431 Feb 10 03:37:58.769536 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 67/133] 10.222.0.32 () {60 vars in 1315 bytes} [Thu Feb 10 03:37:58 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:37:58.812480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5b05f830-da20-4cd9-aeaa-ea81676d8960 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:37:58.820243 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5b05f830-da20-4cd9-aeaa-ea81676d8960 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.203871 Feb 10 03:37:58.820887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 67/134] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:58 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:37:59.842195 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-48d2d23c-a48d-47b5-97dd-19ea17f5f98f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:37:59.845084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-48d2d23c-a48d-47b5-97dd-19ea17f5f98f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:37:59.851208 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-48d2d23c-a48d-47b5-97dd-19ea17f5f98f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:59.851735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-48d2d23c-a48d-47b5-97dd-19ea17f5f98f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:37:59.852618 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-48d2d23c-a48d-47b5-97dd-19ea17f5f98f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:37:59.853123 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-48d2d23c-a48d-47b5-97dd-19ea17f5f98f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:00.003186 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-48d2d23c-a48d-47b5-97dd-19ea17f5f98f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:00.016604 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-48d2d23c-a48d-47b5-97dd-19ea17f5f98f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.183880 Feb 10 03:38:00.017350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 68/135] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:37:59 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:00.161512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:00.162116 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:00.163530 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-7322f7d5-f627-4b4b-bdcc-08e4c28e3ae5 req-a2409df2-cb84-40ec-a495-4830178de191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d302b3d4-6282-4fbe-a4c4-248881ee8f51", "tag": "29a0a5b3-6729-4753-8ce5-55f51a8c9a2e"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:00.165179 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:00.165179 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:00.168970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:00.170065 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:00.170887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:00.171318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:00.172019 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-7322f7d5-f627-4b4b-bdcc-08e4c28e3ae5 req-a2409df2-cb84-40ec-a495-4830178de191 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:00.172458 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-7322f7d5-f627-4b4b-bdcc-08e4c28e3ae5 req-a2409df2-cb84-40ec-a495-4830178de191 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:00.192868 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-7322f7d5-f627-4b4b-bdcc-08e4c28e3ae5 req-a2409df2-cb84-40ec-a495-4830178de191 service nova] Creating event network-changed:29a0a5b3-6729-4753-8ce5-55f51a8c9a2e for instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 on hv-cinder-82806 Feb 10 03:38:00.197855 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-7322f7d5-f627-4b4b-bdcc-08e4c28e3ae5 req-a2409df2-cb84-40ec-a495-4830178de191 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037840 Feb 10 03:38:00.198748 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 69/136] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:38:00.318794 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:00.327421 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:00.329042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:00.330335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dcd675c5-a359-48d6-8855-a55f3eb6a827 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1597 microversion: 2.20 time: 0.172695 Feb 10 03:38:00.330966 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 68/137] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:38:00 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1597 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:38:01.034320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-055de9e7-addf-4107-87e6-114fb07cccb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:01.035055 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-055de9e7-addf-4107-87e6-114fb07cccb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:01.041933 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-055de9e7-addf-4107-87e6-114fb07cccb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:01.042377 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-055de9e7-addf-4107-87e6-114fb07cccb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:01.043185 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-055de9e7-addf-4107-87e6-114fb07cccb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:01.043612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-055de9e7-addf-4107-87e6-114fb07cccb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:01.186246 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-055de9e7-addf-4107-87e6-114fb07cccb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:01.194072 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-055de9e7-addf-4107-87e6-114fb07cccb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.164221 Feb 10 03:38:01.202531 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 70/138] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:01 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:01.348100 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:01.348858 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:01.357214 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:01.357914 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:01.359278 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:01.359891 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:01.538910 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:01.548616 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:01.550325 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:01.551593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a6facfc9-362e-44c9-bae8-dc1bb00ce896 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1597 microversion: 2.20 time: 0.207485 Feb 10 03:38:01.552150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 69/139] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:38:01 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1597 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:38:02.211368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b8aabaf1-77d6-4aaa-b804-a8516d94e898 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:02.211973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b8aabaf1-77d6-4aaa-b804-a8516d94e898 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:02.219852 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b8aabaf1-77d6-4aaa-b804-a8516d94e898 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:02.220217 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b8aabaf1-77d6-4aaa-b804-a8516d94e898 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:02.221009 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b8aabaf1-77d6-4aaa-b804-a8516d94e898 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:02.221442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b8aabaf1-77d6-4aaa-b804-a8516d94e898 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:02.361110 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b8aabaf1-77d6-4aaa-b804-a8516d94e898 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:02.369215 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b8aabaf1-77d6-4aaa-b804-a8516d94e898 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.161731 Feb 10 03:38:02.369984 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 71/140] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:02 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:02.569300 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:02.569957 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:02.576584 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:02.577119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:02.577953 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:02.578402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:02.704980 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-300470088", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:02.763987 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] validate_networks() for None {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:38:02.801927 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:02.809995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:02.811541 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:02.812701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d63e21e3-b69c-4be4-940b-805833b89bb2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1597 microversion: 2.20 time: 0.247249 Feb 10 03:38:02.813578 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 70/141] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:38:02 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1597 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:38:03.232240 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:38:03.232746 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:38:03.233112 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:38:03.233517 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:38:03.233929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:38:03.242880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:03.243331 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:03.244194 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:03.244824 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:03.262306 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Getting quotas for project 40bfef4d74674be08aca4f965b2c2166. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:03.267129 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Getting quotas for user 53ecdf0e91ea4289bbc145d4c0970795 and project 40bfef4d74674be08aca4f965b2c2166. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:03.279537 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:38:03.281886 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:38:03.328501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-99f73977-2f59-4d41-95cb-7b8a67b57f42 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627727 Feb 10 03:38:03.329151 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 72/142] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:38:03.338933 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-90e88e1c-6c3d-48ab-b34e-b5c5974de52f tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:03.339524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-90e88e1c-6c3d-48ab-b34e-b5c5974de52f tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:03.387400 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-99ca3399-f287-45f8-9312-4f3e0c603319 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:03.388115 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-99ca3399-f287-45f8-9312-4f3e0c603319 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:03.394550 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-99ca3399-f287-45f8-9312-4f3e0c603319 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:03.394966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-99ca3399-f287-45f8-9312-4f3e0c603319 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:03.395797 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-99ca3399-f287-45f8-9312-4f3e0c603319 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:03.396234 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-99ca3399-f287-45f8-9312-4f3e0c603319 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:03.397970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-90e88e1c-6c3d-48ab-b34e-b5c5974de52f tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:03.405121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-90e88e1c-6c3d-48ab-b34e-b5c5974de52f tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1214 microversion: 2.1 time: 0.069860 Feb 10 03:38:03.406611 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 71/143] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:03 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:03.542837 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-99ca3399-f287-45f8-9312-4f3e0c603319 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:03.552359 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-99ca3399-f287-45f8-9312-4f3e0c603319 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.168342 Feb 10 03:38:03.552359 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 73/144] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:03 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:03.830703 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:03.831312 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:03.837391 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:03.837833 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:03.838610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:03.839070 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:03.985322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:03.996939 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:03.998971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:04.000133 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c6bd8317-fa79-4123-83b7-e0b3268c67b7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1597 microversion: 2.20 time: 0.173019 Feb 10 03:38:04.000683 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 72/145] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:38:03 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1597 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:38:04.423156 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1cc7326b-a1df-4099-8542-3f654116adfd tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:04.424721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1cc7326b-a1df-4099-8542-3f654116adfd tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:04.431504 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1cc7326b-a1df-4099-8542-3f654116adfd tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:04.432032 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1cc7326b-a1df-4099-8542-3f654116adfd tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:04.432859 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1cc7326b-a1df-4099-8542-3f654116adfd tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:04.433291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1cc7326b-a1df-4099-8542-3f654116adfd tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:04.504030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1cc7326b-a1df-4099-8542-3f654116adfd tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:04.511473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1cc7326b-a1df-4099-8542-3f654116adfd tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1218 microversion: 2.1 time: 0.092051 Feb 10 03:38:04.512042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 74/146] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:04 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:04.568611 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-62f014ce-0265-4878-b37a-bc2ea0a11969 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:04.569553 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-62f014ce-0265-4878-b37a-bc2ea0a11969 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:04.576221 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-62f014ce-0265-4878-b37a-bc2ea0a11969 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:04.576716 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-62f014ce-0265-4878-b37a-bc2ea0a11969 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:04.577743 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-62f014ce-0265-4878-b37a-bc2ea0a11969 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:04.578184 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-62f014ce-0265-4878-b37a-bc2ea0a11969 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:04.722747 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-62f014ce-0265-4878-b37a-bc2ea0a11969 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:04.730755 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-62f014ce-0265-4878-b37a-bc2ea0a11969 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1362 microversion: 2.1 time: 0.165914 Feb 10 03:38:04.731335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 73/147] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:04 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:05.018367 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:05.019279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:05.025319 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.025870 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.027067 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.027621 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.191161 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:05.202571 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:05.204320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:05.205883 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a4e93892-e71f-4919-bc86-f57cbfc0b2a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1716 microversion: 2.20 time: 0.191318 Feb 10 03:38:05.206440 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 75/148] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:38:05 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1716 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:38:05.225811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-73a1e96b-af3e-4a81-bcdd-4b2e540f59b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:05.226391 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-73a1e96b-af3e-4a81-bcdd-4b2e540f59b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:05.240143 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-73a1e96b-af3e-4a81-bcdd-4b2e540f59b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.240598 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-73a1e96b-af3e-4a81-bcdd-4b2e540f59b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.244112 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-73a1e96b-af3e-4a81-bcdd-4b2e540f59b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.247322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-73a1e96b-af3e-4a81-bcdd-4b2e540f59b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.277777 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-73a1e96b-af3e-4a81-bcdd-4b2e540f59b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/ips" status: 200 len: 152 microversion: 2.20 time: 0.057596 Feb 10 03:38:05.278471 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 74/149] 10.222.0.32 () {60 vars in 1288 bytes} [Thu Feb 10 03:38:05 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/ips => generated 152 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:38:05.530452 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1c1604cf-5add-4f79-8850-0ec416da6e67 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:05.536452 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1c1604cf-5add-4f79-8850-0ec416da6e67 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:05.545665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1c1604cf-5add-4f79-8850-0ec416da6e67 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.546404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1c1604cf-5add-4f79-8850-0ec416da6e67 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.547705 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1c1604cf-5add-4f79-8850-0ec416da6e67 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.548288 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1c1604cf-5add-4f79-8850-0ec416da6e67 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.655427 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1c1604cf-5add-4f79-8850-0ec416da6e67 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:05.669920 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1c1604cf-5add-4f79-8850-0ec416da6e67 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1272 microversion: 2.1 time: 0.141690 Feb 10 03:38:05.670727 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 76/150] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:05 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:05.752490 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d6c06327-f351-4281-9904-d85ee2ff11e0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:05.753681 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d6c06327-f351-4281-9904-d85ee2ff11e0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:05.760479 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d6c06327-f351-4281-9904-d85ee2ff11e0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.761070 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d6c06327-f351-4281-9904-d85ee2ff11e0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.762095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d6c06327-f351-4281-9904-d85ee2ff11e0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.762526 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d6c06327-f351-4281-9904-d85ee2ff11e0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.928791 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d6c06327-f351-4281-9904-d85ee2ff11e0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:05.936986 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d6c06327-f351-4281-9904-d85ee2ff11e0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1547 microversion: 2.1 time: 0.193052 Feb 10 03:38:05.938205 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 75/151] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:05 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1547 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:05.953784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-34254300-4cf3-426a-8135-9a8f7273211b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:05.954418 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-34254300-4cf3-426a-8135-9a8f7273211b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:05.962095 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-34254300-4cf3-426a-8135-9a8f7273211b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.962541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-34254300-4cf3-426a-8135-9a8f7273211b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:05.963363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-34254300-4cf3-426a-8135-9a8f7273211b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:05.963796 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-34254300-4cf3-426a-8135-9a8f7273211b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:06.067401 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-34254300-4cf3-426a-8135-9a8f7273211b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117044 Feb 10 03:38:06.068723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 77/152] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Feb 10 03:38:05 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:06.688804 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-84626ef0-083a-4f5d-8672-f80f33adc36d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:06.689412 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-84626ef0-083a-4f5d-8672-f80f33adc36d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:06.701385 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-84626ef0-083a-4f5d-8672-f80f33adc36d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:06.701847 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-84626ef0-083a-4f5d-8672-f80f33adc36d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:06.702673 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-84626ef0-083a-4f5d-8672-f80f33adc36d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:06.703432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-84626ef0-083a-4f5d-8672-f80f33adc36d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:07.050259 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-84626ef0-083a-4f5d-8672-f80f33adc36d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:07.061089 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-84626ef0-083a-4f5d-8672-f80f33adc36d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1314 microversion: 2.1 time: 0.375747 Feb 10 03:38:07.062792 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 76/153] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:06 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:07.608735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-5f440aa5-8454-4cd1-9905-177eef3f040f req-c15b76eb-3812-44a2-9d77-33829a24ff8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7111ed7d-a304-4363-bd54-ab38f6da8932", "tag": "7438d24c-e614-4048-b3f8-5c54eb8f7645"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:07.610544 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:07.610544 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:07.631955 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-5f440aa5-8454-4cd1-9905-177eef3f040f req-c15b76eb-3812-44a2-9d77-33829a24ff8f service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:07.632309 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-5f440aa5-8454-4cd1-9905-177eef3f040f req-c15b76eb-3812-44a2-9d77-33829a24ff8f service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:07.679258 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-5f440aa5-8454-4cd1-9905-177eef3f040f req-c15b76eb-3812-44a2-9d77-33829a24ff8f service nova] Creating event network-changed:7438d24c-e614-4048-b3f8-5c54eb8f7645 for instance 7111ed7d-a304-4363-bd54-ab38f6da8932 on hv-cinder-82806 Feb 10 03:38:07.706673 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-5f440aa5-8454-4cd1-9905-177eef3f040f req-c15b76eb-3812-44a2-9d77-33829a24ff8f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104577 Feb 10 03:38:07.712946 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 78/154] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:38:08.080153 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-28ef6c8f-54b1-411d-a2ee-21b47e03e4c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:08.080921 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-28ef6c8f-54b1-411d-a2ee-21b47e03e4c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:08.092155 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-28ef6c8f-54b1-411d-a2ee-21b47e03e4c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:08.093660 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-28ef6c8f-54b1-411d-a2ee-21b47e03e4c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:08.096454 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ed7e86af-35c5-4fa8-9c89-852b90ba400f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:08.097237 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ed7e86af-35c5-4fa8-9c89-852b90ba400f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:08.097574 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-28ef6c8f-54b1-411d-a2ee-21b47e03e4c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:08.098136 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-28ef6c8f-54b1-411d-a2ee-21b47e03e4c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:08.110413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ed7e86af-35c5-4fa8-9c89-852b90ba400f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:08.112447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ed7e86af-35c5-4fa8-9c89-852b90ba400f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:08.113885 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ed7e86af-35c5-4fa8-9c89-852b90ba400f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:08.114576 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ed7e86af-35c5-4fa8-9c89-852b90ba400f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:08.358197 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-28ef6c8f-54b1-411d-a2ee-21b47e03e4c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:08.361363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ed7e86af-35c5-4fa8-9c89-852b90ba400f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:08.367651 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-28ef6c8f-54b1-411d-a2ee-21b47e03e4c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1314 microversion: 2.1 time: 0.291547 Feb 10 03:38:08.368242 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 77/155] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:08 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:08.370272 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ed7e86af-35c5-4fa8-9c89-852b90ba400f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1547 microversion: 2.1 time: 0.278892 Feb 10 03:38:08.371023 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 79/156] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:08 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1547 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:08.384775 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-b07868fb-e795-4eeb-aedd-8177f5723398 req-96c90e6a-10d1-458e-bf23-d8d20701931a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60b46a9-24cb-430f-83bd-3c74a87a08cd", "tag": "2f6a5eaa-729c-49cc-aff5-a2c491acd54d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:08.387330 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:08.387330 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:38:08.399282 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-b07868fb-e795-4eeb-aedd-8177f5723398 req-96c90e6a-10d1-458e-bf23-d8d20701931a service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:08.399748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-b07868fb-e795-4eeb-aedd-8177f5723398 req-96c90e6a-10d1-458e-bf23-d8d20701931a service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:08.418184 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-b07868fb-e795-4eeb-aedd-8177f5723398 req-96c90e6a-10d1-458e-bf23-d8d20701931a service nova] Creating event network-changed:2f6a5eaa-729c-49cc-aff5-a2c491acd54d for instance d60b46a9-24cb-430f-83bd-3c74a87a08cd on hv-cinder-82806 Feb 10 03:38:08.428120 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-b07868fb-e795-4eeb-aedd-8177f5723398 req-96c90e6a-10d1-458e-bf23-d8d20701931a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057637 Feb 10 03:38:08.429313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 78/157] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:09.385050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bf56469c-3111-4f49-9566-116c5f436b95 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:09.386571 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bf56469c-3111-4f49-9566-116c5f436b95 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:09.388073 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-96aaa1ae-3db7-47da-b677-16499dbfab83 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:09.388760 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-96aaa1ae-3db7-47da-b677-16499dbfab83 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:09.395456 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf56469c-3111-4f49-9566-116c5f436b95 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:09.396122 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf56469c-3111-4f49-9566-116c5f436b95 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:09.397141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf56469c-3111-4f49-9566-116c5f436b95 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:09.397760 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf56469c-3111-4f49-9566-116c5f436b95 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:09.400235 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-96aaa1ae-3db7-47da-b677-16499dbfab83 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:09.400707 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-96aaa1ae-3db7-47da-b677-16499dbfab83 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:09.401477 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-96aaa1ae-3db7-47da-b677-16499dbfab83 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:09.401904 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-96aaa1ae-3db7-47da-b677-16499dbfab83 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:09.689630 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bf56469c-3111-4f49-9566-116c5f436b95 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:09.702493 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bf56469c-3111-4f49-9566-116c5f436b95 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1314 microversion: 2.1 time: 0.321396 Feb 10 03:38:09.705446 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 80/158] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:09 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:09.715167 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-96aaa1ae-3db7-47da-b677-16499dbfab83 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:09.725183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-96aaa1ae-3db7-47da-b677-16499dbfab83 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1547 microversion: 2.1 time: 0.340936 Feb 10 03:38:09.734898 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 79/159] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:09 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1547 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:10.719470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-11683551-b57c-4b4c-b989-a1986fc356f9 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:10.721634 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-11683551-b57c-4b4c-b989-a1986fc356f9 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:10.729022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-11683551-b57c-4b4c-b989-a1986fc356f9 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:10.729535 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-11683551-b57c-4b4c-b989-a1986fc356f9 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:10.730543 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-11683551-b57c-4b4c-b989-a1986fc356f9 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:10.731075 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-11683551-b57c-4b4c-b989-a1986fc356f9 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:10.742380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a95a2fcd-562d-440e-ba1b-06f84cc8fe34 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:10.743103 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a95a2fcd-562d-440e-ba1b-06f84cc8fe34 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:10.749891 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a95a2fcd-562d-440e-ba1b-06f84cc8fe34 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:10.758548 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a95a2fcd-562d-440e-ba1b-06f84cc8fe34 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:10.759581 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a95a2fcd-562d-440e-ba1b-06f84cc8fe34 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:10.760118 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a95a2fcd-562d-440e-ba1b-06f84cc8fe34 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:11.045054 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-11683551-b57c-4b4c-b989-a1986fc356f9 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:11.053124 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a95a2fcd-562d-440e-ba1b-06f84cc8fe34 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:11.053304 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-11683551-b57c-4b4c-b989-a1986fc356f9 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1314 microversion: 2.1 time: 0.337618 Feb 10 03:38:11.054119 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 81/160] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:10 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:11.064654 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a95a2fcd-562d-440e-ba1b-06f84cc8fe34 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1666 microversion: 2.1 time: 0.325147 Feb 10 03:38:11.066443 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 80/161] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:10 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1666 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:11.082142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3ec192ee-80a8-4311-9b8e-d9697790470c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:11.082668 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3ec192ee-80a8-4311-9b8e-d9697790470c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:11.089127 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ec192ee-80a8-4311-9b8e-d9697790470c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:11.089873 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ec192ee-80a8-4311-9b8e-d9697790470c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:11.090850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ec192ee-80a8-4311-9b8e-d9697790470c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:11.091511 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ec192ee-80a8-4311-9b8e-d9697790470c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:11.119167 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3ec192ee-80a8-4311-9b8e-d9697790470c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/ips" status: 200 len: 145 microversion: 2.1 time: 0.041162 Feb 10 03:38:11.120249 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 82/162] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Feb 10 03:38:11 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:12.070974 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-06b1edf7-2b72-443f-86da-c3d92635165d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:12.072998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-06b1edf7-2b72-443f-86da-c3d92635165d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:12.081941 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-06b1edf7-2b72-443f-86da-c3d92635165d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:12.085288 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-06b1edf7-2b72-443f-86da-c3d92635165d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:12.086376 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-06b1edf7-2b72-443f-86da-c3d92635165d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:12.087144 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-06b1edf7-2b72-443f-86da-c3d92635165d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:12.295182 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-06b1edf7-2b72-443f-86da-c3d92635165d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:12.306418 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-06b1edf7-2b72-443f-86da-c3d92635165d tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1314 microversion: 2.1 time: 0.239234 Feb 10 03:38:12.307191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 81/163] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:12 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:13.325444 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e9ea41f7-6a2d-4d1e-b7f3-b72e5d5cd2f1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:13.326185 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e9ea41f7-6a2d-4d1e-b7f3-b72e5d5cd2f1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:13.332956 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e9ea41f7-6a2d-4d1e-b7f3-b72e5d5cd2f1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:13.333404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e9ea41f7-6a2d-4d1e-b7f3-b72e5d5cd2f1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:13.334181 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e9ea41f7-6a2d-4d1e-b7f3-b72e5d5cd2f1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:13.334611 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e9ea41f7-6a2d-4d1e-b7f3-b72e5d5cd2f1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:13.693695 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-9d50b185-c29e-4cf3-9597-43072cd31510 req-ded45ed7-6a66-47c7-aa85-607da9d9be0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7111ed7d-a304-4363-bd54-ab38f6da8932", "name": "network-vif-plugged", "status": "completed", "tag": "7438d24c-e614-4048-b3f8-5c54eb8f7645"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:13.700115 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e9ea41f7-6a2d-4d1e-b7f3-b72e5d5cd2f1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:13.706375 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:13.706375 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:38:13.714213 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e9ea41f7-6a2d-4d1e-b7f3-b72e5d5cd2f1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1314 microversion: 2.1 time: 0.392748 Feb 10 03:38:13.718440 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 83/164] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:13 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:13.722325 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-9d50b185-c29e-4cf3-9597-43072cd31510 req-ded45ed7-6a66-47c7-aa85-607da9d9be0b service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:13.722944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-9d50b185-c29e-4cf3-9597-43072cd31510 req-ded45ed7-6a66-47c7-aa85-607da9d9be0b service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:13.759503 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-9d50b185-c29e-4cf3-9597-43072cd31510 req-ded45ed7-6a66-47c7-aa85-607da9d9be0b service nova] Creating event network-vif-plugged:7438d24c-e614-4048-b3f8-5c54eb8f7645 for instance 7111ed7d-a304-4363-bd54-ab38f6da8932 on hv-cinder-82806 Feb 10 03:38:13.765176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-9d50b185-c29e-4cf3-9597-43072cd31510 req-ded45ed7-6a66-47c7-aa85-607da9d9be0b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088884 Feb 10 03:38:13.766414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 82/165] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:38:13.997619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-412111677", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "4fceb00b-34fd-4a2b-b18c-a9d9c74a66d0"}]}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:14.062027 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] validate_networks() for [('4fceb00b-34fd-4a2b-b18c-a9d9c74a66d0', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:38:14.110073 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2026070571", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "76e22acc-1b00-4e17-aaca-a2a7c6c019ee"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:14.183299 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] validate_networks() for [('76e22acc-1b00-4e17-aaca-a2a7c6c019ee', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:38:14.770823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:38:14.771949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:38:14.772566 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:38:14.772992 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:38:14.773800 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:38:14.783782 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:14.784248 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:14.785538 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:14.786239 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:14.787886 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:38:14.788319 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:38:14.788759 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:38:14.789700 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:38:14.790104 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:38:14.804124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:14.804124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:14.804124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:14.804451 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Getting quotas for project b5f20a9d15eb4d99bf667578a36a9f55. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:14.804579 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:14.809392 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Getting quotas for user 30c4ac1332b64a648d7214918f757f83 and project b5f20a9d15eb4d99bf667578a36a9f55. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:14.820677 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:38:14.823599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:38:14.823766 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Getting quotas for project d7bf7bed71094487b57906e39d043543. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:14.828906 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Getting quotas for user 5adf0f1d005d4a1eb0136d4593b094b5 and project d7bf7bed71094487b57906e39d043543. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:14.842403 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:38:14.844979 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:38:14.873705 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-718dc88e-355c-4396-b19b-1aa92b3ab67f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768821 Feb 10 03:38:14.875086 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 83/166] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:38:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 10 03:38:14.882445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0fddcbcf-8690-480e-a2f6-cc7d6a433b89 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:14.883421 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0fddcbcf-8690-480e-a2f6-cc7d6a433b89 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:14.891741 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0fddcbcf-8690-480e-a2f6-cc7d6a433b89 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:14.892459 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0fddcbcf-8690-480e-a2f6-cc7d6a433b89 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:14.893700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0fddcbcf-8690-480e-a2f6-cc7d6a433b89 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:14.894362 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0fddcbcf-8690-480e-a2f6-cc7d6a433b89 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:14.910964 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-43cfbd4b-5cf6-43be-9f15-bd600a4d8100 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917741 Feb 10 03:38:14.912646 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 84/167] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:38:14.924014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ca66bfb3-9b55-4aca-be3b-cb73f14e0bea tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:14.925045 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ca66bfb3-9b55-4aca-be3b-cb73f14e0bea tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:15.032629 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ca66bfb3-9b55-4aca-be3b-cb73f14e0bea tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:15.046750 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ca66bfb3-9b55-4aca-be3b-cb73f14e0bea tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1214 microversion: 2.1 time: 0.132797 Feb 10 03:38:15.047811 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 85/168] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:14 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:15.053882 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-8b88869e-02eb-4ca0-8051-e3027193cf2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:15.055210 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8b88869e-02eb-4ca0-8051-e3027193cf2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:15.161471 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-8b88869e-02eb-4ca0-8051-e3027193cf2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:15.167693 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0fddcbcf-8690-480e-a2f6-cc7d6a433b89 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:15.177562 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-8b88869e-02eb-4ca0-8051-e3027193cf2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1217 microversion: 2.1 time: 0.128484 Feb 10 03:38:15.178677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 86/169] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:15 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:15.187720 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0fddcbcf-8690-480e-a2f6-cc7d6a433b89 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1314 microversion: 2.1 time: 0.310949 Feb 10 03:38:15.189128 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 84/170] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:14 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:16.064451 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0e5dfb03-0647-40e7-9e87-b482956ee2f1 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:16.065342 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0e5dfb03-0647-40e7-9e87-b482956ee2f1 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:16.076157 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0e5dfb03-0647-40e7-9e87-b482956ee2f1 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.077076 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0e5dfb03-0647-40e7-9e87-b482956ee2f1 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.078428 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0e5dfb03-0647-40e7-9e87-b482956ee2f1 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.079161 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0e5dfb03-0647-40e7-9e87-b482956ee2f1 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.153318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0e5dfb03-0647-40e7-9e87-b482956ee2f1 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:16.161591 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0e5dfb03-0647-40e7-9e87-b482956ee2f1 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1266 microversion: 2.1 time: 0.101526 Feb 10 03:38:16.171401 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 87/171] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:16 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:16.197409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e9ecf8e7-465f-4d3c-81c9-e2baafb3ca15 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:16.198280 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e9ecf8e7-465f-4d3c-81c9-e2baafb3ca15 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:16.204938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-89daa010-fa61-4c13-b2d2-abe483053c21 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:16.205140 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e9ecf8e7-465f-4d3c-81c9-e2baafb3ca15 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.205545 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-89daa010-fa61-4c13-b2d2-abe483053c21 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:16.205658 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e9ecf8e7-465f-4d3c-81c9-e2baafb3ca15 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.206404 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e9ecf8e7-465f-4d3c-81c9-e2baafb3ca15 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.206872 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e9ecf8e7-465f-4d3c-81c9-e2baafb3ca15 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.211990 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-89daa010-fa61-4c13-b2d2-abe483053c21 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.212465 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-89daa010-fa61-4c13-b2d2-abe483053c21 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.213245 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-89daa010-fa61-4c13-b2d2-abe483053c21 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.213674 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-89daa010-fa61-4c13-b2d2-abe483053c21 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.277276 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e9ecf8e7-465f-4d3c-81c9-e2baafb3ca15 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:16.284879 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e9ecf8e7-465f-4d3c-81c9-e2baafb3ca15 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1269 microversion: 2.1 time: 0.091187 Feb 10 03:38:16.285838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 85/172] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:16 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:16.367440 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-89daa010-fa61-4c13-b2d2-abe483053c21 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:16.376607 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-89daa010-fa61-4c13-b2d2-abe483053c21 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1463 microversion: 2.1 time: 0.174704 Feb 10 03:38:16.377205 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 88/173] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:16 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1463 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:16.413551 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-978665e8-f8d4-4dff-99cd-e40b965386f7 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:16.414151 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-978665e8-f8d4-4dff-99cd-e40b965386f7 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:16.421196 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-978665e8-f8d4-4dff-99cd-e40b965386f7 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.421740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-978665e8-f8d4-4dff-99cd-e40b965386f7 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.422584 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-978665e8-f8d4-4dff-99cd-e40b965386f7 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.423063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-978665e8-f8d4-4dff-99cd-e40b965386f7 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.453932 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-978665e8-f8d4-4dff-99cd-e40b965386f7 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:38:16.549871 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-978665e8-f8d4-4dff-99cd-e40b965386f7 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 204 len: 0 microversion: 2.1 time: 0.139617 Feb 10 03:38:16.550971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 86/174] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:38:16 2022] DELETE /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:38:16.559076 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f677d0d4-5987-40e9-b581-bf5a174985d1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:16.559794 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f677d0d4-5987-40e9-b581-bf5a174985d1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:16.566201 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f677d0d4-5987-40e9-b581-bf5a174985d1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.566578 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f677d0d4-5987-40e9-b581-bf5a174985d1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.567599 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f677d0d4-5987-40e9-b581-bf5a174985d1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:16.568039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f677d0d4-5987-40e9-b581-bf5a174985d1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:16.728457 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f677d0d4-5987-40e9-b581-bf5a174985d1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:16.736787 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f677d0d4-5987-40e9-b581-bf5a174985d1 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1469 microversion: 2.1 time: 0.181401 Feb 10 03:38:16.740726 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 89/175] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:16 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:17.181395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c8ee7278-225b-42f9-8416-b1cf85ba9163 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:17.182724 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c8ee7278-225b-42f9-8416-b1cf85ba9163 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:17.191887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c8ee7278-225b-42f9-8416-b1cf85ba9163 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:17.207444 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c8ee7278-225b-42f9-8416-b1cf85ba9163 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:17.208827 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c8ee7278-225b-42f9-8416-b1cf85ba9163 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:17.209282 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c8ee7278-225b-42f9-8416-b1cf85ba9163 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:17.301657 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d4b8a4d6-b4b0-4b8a-9d60-86a5f31ec290 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:17.302416 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d4b8a4d6-b4b0-4b8a-9d60-86a5f31ec290 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:17.311641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4b8a4d6-b4b0-4b8a-9d60-86a5f31ec290 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:17.312249 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4b8a4d6-b4b0-4b8a-9d60-86a5f31ec290 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:17.313138 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4b8a4d6-b4b0-4b8a-9d60-86a5f31ec290 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:17.313791 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4b8a4d6-b4b0-4b8a-9d60-86a5f31ec290 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:17.323201 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c8ee7278-225b-42f9-8416-b1cf85ba9163 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:17.331358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c8ee7278-225b-42f9-8416-b1cf85ba9163 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1272 microversion: 2.1 time: 0.156079 Feb 10 03:38:17.332867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 87/176] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:17 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:17.398538 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d4b8a4d6-b4b0-4b8a-9d60-86a5f31ec290 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:17.407168 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d4b8a4d6-b4b0-4b8a-9d60-86a5f31ec290 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1275 microversion: 2.1 time: 0.108757 Feb 10 03:38:17.407460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 90/177] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:17 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:17.758788 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1031b886-1bea-4ce5-b00f-58dcfb309c55 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:17.759556 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1031b886-1bea-4ce5-b00f-58dcfb309c55 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:17.767529 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1031b886-1bea-4ce5-b00f-58dcfb309c55 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:17.768307 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1031b886-1bea-4ce5-b00f-58dcfb309c55 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:17.769322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1031b886-1bea-4ce5-b00f-58dcfb309c55 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:17.769944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1031b886-1bea-4ce5-b00f-58dcfb309c55 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:18.003571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1031b886-1bea-4ce5-b00f-58dcfb309c55 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:18.016419 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1031b886-1bea-4ce5-b00f-58dcfb309c55 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1469 microversion: 2.1 time: 0.262325 Feb 10 03:38:18.017192 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 88/178] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:17 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:18.350865 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-8e1ae46a-1684-426c-b44a-51fa3d3dda33 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:18.352154 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8e1ae46a-1684-426c-b44a-51fa3d3dda33 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:18.360471 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8e1ae46a-1684-426c-b44a-51fa3d3dda33 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:18.361329 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8e1ae46a-1684-426c-b44a-51fa3d3dda33 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:18.362523 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8e1ae46a-1684-426c-b44a-51fa3d3dda33 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:18.363668 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8e1ae46a-1684-426c-b44a-51fa3d3dda33 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:18.429191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b624f935-bf93-42a3-80b7-038fc933528e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:18.429906 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b624f935-bf93-42a3-80b7-038fc933528e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:18.445585 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b624f935-bf93-42a3-80b7-038fc933528e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:18.447424 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b624f935-bf93-42a3-80b7-038fc933528e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:18.452610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b624f935-bf93-42a3-80b7-038fc933528e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:18.453073 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b624f935-bf93-42a3-80b7-038fc933528e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:18.765687 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-8e1ae46a-1684-426c-b44a-51fa3d3dda33 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:18.783707 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-8e1ae46a-1684-426c-b44a-51fa3d3dda33 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.438359 Feb 10 03:38:18.784311 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 91/179] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:18 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:18.819250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b624f935-bf93-42a3-80b7-038fc933528e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:18.828266 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b624f935-bf93-42a3-80b7-038fc933528e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.405378 Feb 10 03:38:18.829488 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 89/180] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:18 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:19.035288 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-db3e5135-a34b-409b-a540-1eb3cc8f72a5 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:19.037018 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-db3e5135-a34b-409b-a540-1eb3cc8f72a5 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:19.045861 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-db3e5135-a34b-409b-a540-1eb3cc8f72a5 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:19.047377 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-db3e5135-a34b-409b-a540-1eb3cc8f72a5 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:19.048950 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-db3e5135-a34b-409b-a540-1eb3cc8f72a5 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:19.050300 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-db3e5135-a34b-409b-a540-1eb3cc8f72a5 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:19.309796 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-db3e5135-a34b-409b-a540-1eb3cc8f72a5 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:19.318694 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-db3e5135-a34b-409b-a540-1eb3cc8f72a5 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1469 microversion: 2.1 time: 0.288126 Feb 10 03:38:19.320297 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 92/181] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:19 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:19.636942 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-0af8fe9d-d07d-4e54-b501-5ba3ac5b5078 req-473cabe3-ae18-4a65-baa5-d5ac9f21d750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c3e5b6-954c-43c8-869e-194537294af8", "tag": "3e7a4b38-86d1-4977-a09a-05920db48467"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:19.639700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:19.639700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:38:19.665865 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-0af8fe9d-d07d-4e54-b501-5ba3ac5b5078 req-473cabe3-ae18-4a65-baa5-d5ac9f21d750 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:19.667630 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-0af8fe9d-d07d-4e54-b501-5ba3ac5b5078 req-473cabe3-ae18-4a65-baa5-d5ac9f21d750 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:19.801737 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-70b79540-2450-4189-afcb-a03a7caf743d tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:19.803138 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-70b79540-2450-4189-afcb-a03a7caf743d tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:19.816586 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-70b79540-2450-4189-afcb-a03a7caf743d tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:19.817038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-70b79540-2450-4189-afcb-a03a7caf743d tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:19.817851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-70b79540-2450-4189-afcb-a03a7caf743d tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:19.828789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-70b79540-2450-4189-afcb-a03a7caf743d tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:20.010755 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-0af8fe9d-d07d-4e54-b501-5ba3ac5b5078 req-473cabe3-ae18-4a65-baa5-d5ac9f21d750 service nova] Creating event network-changed:3e7a4b38-86d1-4977-a09a-05920db48467 for instance a6c3e5b6-954c-43c8-869e-194537294af8 on hv-cinder-82806 Feb 10 03:38:20.016950 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-0af8fe9d-d07d-4e54-b501-5ba3ac5b5078 req-473cabe3-ae18-4a65-baa5-d5ac9f21d750 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386602 Feb 10 03:38:20.017561 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 90/182] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:20.029327 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-aef8920c-af2c-48f0-9e22-8501340eab16 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:20.030030 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-aef8920c-af2c-48f0-9e22-8501340eab16 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:20.040675 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aef8920c-af2c-48f0-9e22-8501340eab16 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:20.041121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aef8920c-af2c-48f0-9e22-8501340eab16 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:20.041909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aef8920c-af2c-48f0-9e22-8501340eab16 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:20.042341 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aef8920c-af2c-48f0-9e22-8501340eab16 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:20.547799 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-aef8920c-af2c-48f0-9e22-8501340eab16 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:20.553120 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-70b79540-2450-4189-afcb-a03a7caf743d tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:20.560201 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-aef8920c-af2c-48f0-9e22-8501340eab16 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.541287 Feb 10 03:38:20.561028 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 91/183] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:20 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:20.570856 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b601657c-8c67-4341-8a2d-e4b7f41534c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:20.571032 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-70b79540-2450-4189-afcb-a03a7caf743d tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.773164 Feb 10 03:38:20.571762 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b601657c-8c67-4341-8a2d-e4b7f41534c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:20.580263 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 93/184] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:19 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:20.591089 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b601657c-8c67-4341-8a2d-e4b7f41534c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:20.592162 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b601657c-8c67-4341-8a2d-e4b7f41534c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:20.594763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b601657c-8c67-4341-8a2d-e4b7f41534c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:20.595321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b601657c-8c67-4341-8a2d-e4b7f41534c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:20.777739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b601657c-8c67-4341-8a2d-e4b7f41534c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:20.791301 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b601657c-8c67-4341-8a2d-e4b7f41534c6 tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1427 microversion: 2.1 time: 0.226215 Feb 10 03:38:20.792378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 92/185] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:20 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1427 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:20.834368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-b685258d-9dd3-464b-bbec-40635aa6b71d req-e9122c03-4e7d-4661-8207-38cae96e59d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7111ed7d-a304-4363-bd54-ab38f6da8932", "name": "network-vif-deleted", "tag": "7438d24c-e614-4048-b3f8-5c54eb8f7645"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:20.836279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:20.836279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:20.862909 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-b685258d-9dd3-464b-bbec-40635aa6b71d req-e9122c03-4e7d-4661-8207-38cae96e59d8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:20.863357 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-b685258d-9dd3-464b-bbec-40635aa6b71d req-e9122c03-4e7d-4661-8207-38cae96e59d8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:20.918040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-b685258d-9dd3-464b-bbec-40635aa6b71d req-e9122c03-4e7d-4661-8207-38cae96e59d8 service nova] Creating event network-vif-deleted:7438d24c-e614-4048-b3f8-5c54eb8f7645 for instance 7111ed7d-a304-4363-bd54-ab38f6da8932 on hv-cinder-82806 Feb 10 03:38:20.939060 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-b685258d-9dd3-464b-bbec-40635aa6b71d req-e9122c03-4e7d-4661-8207-38cae96e59d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105615 Feb 10 03:38:20.941689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 94/186] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:21.390093 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1d908007-18a7-4808-bf2c-86499a01478e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:21.390586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1d908007-18a7-4808-bf2c-86499a01478e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:21.396402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1d908007-18a7-4808-bf2c-86499a01478e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.396849 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1d908007-18a7-4808-bf2c-86499a01478e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.397717 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1d908007-18a7-4808-bf2c-86499a01478e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.398187 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1d908007-18a7-4808-bf2c-86499a01478e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.424066 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1d908007-18a7-4808-bf2c-86499a01478e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:38:21.516150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1d908007-18a7-4808-bf2c-86499a01478e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "DELETE /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 204 len: 0 microversion: 2.1 time: 0.129277 Feb 10 03:38:21.517163 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 93/187] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:38:21 2022] DELETE /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:38:21.526755 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b1a9726a-e546-4745-94e3-1fff112057cb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:21.527760 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b1a9726a-e546-4745-94e3-1fff112057cb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:21.534501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b1a9726a-e546-4745-94e3-1fff112057cb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.535003 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b1a9726a-e546-4745-94e3-1fff112057cb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.535811 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b1a9726a-e546-4745-94e3-1fff112057cb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.536252 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b1a9726a-e546-4745-94e3-1fff112057cb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.578868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6056ba51-5130-4f01-aa3c-026b95a84944 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:21.579899 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6056ba51-5130-4f01-aa3c-026b95a84944 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:21.586764 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6056ba51-5130-4f01-aa3c-026b95a84944 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.587611 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6056ba51-5130-4f01-aa3c-026b95a84944 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.589003 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6056ba51-5130-4f01-aa3c-026b95a84944 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.589786 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6056ba51-5130-4f01-aa3c-026b95a84944 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.864016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b1a9726a-e546-4745-94e3-1fff112057cb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:21.872760 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b1a9726a-e546-4745-94e3-1fff112057cb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1555 microversion: 2.1 time: 0.350578 Feb 10 03:38:21.873344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 95/188] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:21 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1555 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:21.878456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6056ba51-5130-4f01-aa3c-026b95a84944 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:21.885872 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-92c653ea-98e0-4634-af3d-59c590d88e0b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:21.886055 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6056ba51-5130-4f01-aa3c-026b95a84944 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.313190 Feb 10 03:38:21.886517 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-92c653ea-98e0-4634-af3d-59c590d88e0b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:21.886689 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 94/189] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:21 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:21.891051 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:21.891823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:21.893256 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-92c653ea-98e0-4634-af3d-59c590d88e0b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.893717 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-92c653ea-98e0-4634-af3d-59c590d88e0b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.894474 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-92c653ea-98e0-4634-af3d-59c590d88e0b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.895008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-92c653ea-98e0-4634-af3d-59c590d88e0b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.898071 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.898530 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.899347 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.899784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.931744 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:21.932199 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:21.932663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lazy-loading 'fault' on Instance uuid 7111ed7d-a304-4363-bd54-ab38f6da8932 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:38:22.004886 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53ecdf0e91ea4289bbc145d4c0970795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40bfef4d74674be08aca4f965b2c2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:22.013831 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-17aedcf6-e36b-4c4e-92d9-8a96654edb7b tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 200 len: 1304 microversion: 2.1 time: 0.126269 Feb 10 03:38:22.014566 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 95/190] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:21 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:22.036029 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-4f700d94-0955-426a-b3e6-4ce056af511c req-7e1ec625-83c6-42be-a3e3-35031321431e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5026c864-be6c-4702-bd77-88580b382ce7", "tag": "73b9af4c-1633-4ce7-bedf-db767aba25bf"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:22.038050 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:22.038050 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:38:22.048226 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-4f700d94-0955-426a-b3e6-4ce056af511c req-7e1ec625-83c6-42be-a3e3-35031321431e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:22.048756 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-4f700d94-0955-426a-b3e6-4ce056af511c req-7e1ec625-83c6-42be-a3e3-35031321431e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:22.066268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-4f700d94-0955-426a-b3e6-4ce056af511c req-7e1ec625-83c6-42be-a3e3-35031321431e service nova] Creating event network-changed:73b9af4c-1633-4ce7-bedf-db767aba25bf for instance 5026c864-be6c-4702-bd77-88580b382ce7 on hv-cinder-82806 Feb 10 03:38:22.073945 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-4f700d94-0955-426a-b3e6-4ce056af511c req-7e1ec625-83c6-42be-a3e3-35031321431e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041536 Feb 10 03:38:22.078859 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 96/191] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:38:22.093097 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-92c653ea-98e0-4634-af3d-59c590d88e0b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:22.100422 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-92c653ea-98e0-4634-af3d-59c590d88e0b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.218277 Feb 10 03:38:22.100995 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 96/192] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:21 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:22.890688 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7d517bda-5368-4198-a1d0-07a43eefb4bb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:22.891490 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7d517bda-5368-4198-a1d0-07a43eefb4bb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:22.898540 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d517bda-5368-4198-a1d0-07a43eefb4bb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:22.899092 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d517bda-5368-4198-a1d0-07a43eefb4bb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:22.899817 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d517bda-5368-4198-a1d0-07a43eefb4bb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:22.900246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d517bda-5368-4198-a1d0-07a43eefb4bb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:22.902631 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-205ec119-9eca-4114-b742-455675b8c7ce tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:22.903403 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-205ec119-9eca-4114-b742-455675b8c7ce tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:22.910226 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-205ec119-9eca-4114-b742-455675b8c7ce tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:22.910676 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-205ec119-9eca-4114-b742-455675b8c7ce tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:22.911469 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-205ec119-9eca-4114-b742-455675b8c7ce tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:22.911898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-205ec119-9eca-4114-b742-455675b8c7ce tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:23.109044 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7d517bda-5368-4198-a1d0-07a43eefb4bb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:23.112442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-205ec119-9eca-4114-b742-455675b8c7ce tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:23.117620 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7d517bda-5368-4198-a1d0-07a43eefb4bb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1555 microversion: 2.1 time: 0.231089 Feb 10 03:38:23.118188 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 97/193] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:22 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:23.123180 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:23.123784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] [instance: 7111ed7d-a304-4363-bd54-ab38f6da8932] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:23.125920 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-205ec119-9eca-4114-b742-455675b8c7ce tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.227067 Feb 10 03:38:23.129223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 97/194] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:22 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:23.130288 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:23.130783 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:23.131599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:23.132044 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:23.132475 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-72c39029-c2a4-4a44-942e-d7413d1d4b26 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:23.133073 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-72c39029-c2a4-4a44-942e-d7413d1d4b26 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:23.139268 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72c39029-c2a4-4a44-942e-d7413d1d4b26 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:23.139724 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72c39029-c2a4-4a44-942e-d7413d1d4b26 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:23.140525 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72c39029-c2a4-4a44-942e-d7413d1d4b26 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:23.141037 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72c39029-c2a4-4a44-942e-d7413d1d4b26 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:23.148344 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] HTTP exception thrown: Instance 7111ed7d-a304-4363-bd54-ab38f6da8932 could not be found. Feb 10 03:38:23.148980 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] Returning 404 to user: Instance 7111ed7d-a304-4363-bd54-ab38f6da8932 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:38:23.149825 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c30611ea-8482-4342-aa03-49520941e31c tempest-VolumesNegativeTest-1732602853 tempest-VolumesNegativeTest-1732602853-project] 10.222.0.32 "GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932" status: 404 len: 111 microversion: 2.1 time: 0.030441 Feb 10 03:38:23.150348 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 98/195] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:23 2022] GET /compute/v2.1/servers/7111ed7d-a304-4363-bd54-ab38f6da8932 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:38:23.297064 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-72c39029-c2a4-4a44-942e-d7413d1d4b26 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:23.306123 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-72c39029-c2a4-4a44-942e-d7413d1d4b26 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.176668 Feb 10 03:38:23.306123 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 98/196] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:23 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:24.135697 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-200911be-8b4b-4fd8-8ffd-b6d169930e5e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:24.136966 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-200911be-8b4b-4fd8-8ffd-b6d169930e5e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:24.144876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-200911be-8b4b-4fd8-8ffd-b6d169930e5e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:24.145415 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-200911be-8b4b-4fd8-8ffd-b6d169930e5e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:24.146148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-200911be-8b4b-4fd8-8ffd-b6d169930e5e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:24.146540 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-200911be-8b4b-4fd8-8ffd-b6d169930e5e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:24.148432 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a2e461f7-31bf-4c50-a1a6-e050ba2a2267 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:24.149064 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a2e461f7-31bf-4c50-a1a6-e050ba2a2267 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:24.155952 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a2e461f7-31bf-4c50-a1a6-e050ba2a2267 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:24.156385 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a2e461f7-31bf-4c50-a1a6-e050ba2a2267 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:24.157889 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a2e461f7-31bf-4c50-a1a6-e050ba2a2267 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:24.158670 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a2e461f7-31bf-4c50-a1a6-e050ba2a2267 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:24.489271 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a2e461f7-31bf-4c50-a1a6-e050ba2a2267 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:24.495307 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-200911be-8b4b-4fd8-8ffd-b6d169930e5e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:24.504523 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-200911be-8b4b-4fd8-8ffd-b6d169930e5e tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1555 microversion: 2.1 time: 0.372947 Feb 10 03:38:24.505211 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 99/197] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:24 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1555 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:24.509901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a2e461f7-31bf-4c50-a1a6-e050ba2a2267 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.366358 Feb 10 03:38:24.513306 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 99/198] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:24 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:24.518694 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2f6950fb-ed86-432b-b6e6-636ff41665be tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:24.519321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2f6950fb-ed86-432b-b6e6-636ff41665be tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:24.535197 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f6950fb-ed86-432b-b6e6-636ff41665be tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:24.535842 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f6950fb-ed86-432b-b6e6-636ff41665be tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:24.536703 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f6950fb-ed86-432b-b6e6-636ff41665be tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:24.537133 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f6950fb-ed86-432b-b6e6-636ff41665be tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:24.913128 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2f6950fb-ed86-432b-b6e6-636ff41665be tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:24.921669 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2f6950fb-ed86-432b-b6e6-636ff41665be tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.415226 Feb 10 03:38:24.926981 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 100/199] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:24 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:25.051242 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-cc39b3c5-9d1b-4c6b-badf-26210b79a021 req-0c82b503-eb3c-4007-ae87-f23effa55c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84018c6b-a22d-4280-a1a2-e0f2c315c2ce", "name": "network-vif-deleted", "tag": "df41c157-7d92-4a0b-b955-e6573b3cc8f2"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:25.054503 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:25.054503 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:25.076886 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-cc39b3c5-9d1b-4c6b-badf-26210b79a021 req-0c82b503-eb3c-4007-ae87-f23effa55c73 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:25.078299 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-cc39b3c5-9d1b-4c6b-badf-26210b79a021 req-0c82b503-eb3c-4007-ae87-f23effa55c73 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:25.092495 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-cc39b3c5-9d1b-4c6b-badf-26210b79a021 req-0c82b503-eb3c-4007-ae87-f23effa55c73 service nova] Creating event network-vif-deleted:df41c157-7d92-4a0b-b955-e6573b3cc8f2 for instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce on hv-cinder-82806 Feb 10 03:38:25.101130 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-cc39b3c5-9d1b-4c6b-badf-26210b79a021 req-0c82b503-eb3c-4007-ae87-f23effa55c73 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057228 Feb 10 03:38:25.102150 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 100/200] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:25.537073 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7d921220-6eb8-4856-a608-552931727786 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:25.537860 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7d921220-6eb8-4856-a608-552931727786 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:25.542537 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ef52cbbc-fb4d-4d43-a066-561328d88ffb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:25.543262 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ef52cbbc-fb4d-4d43-a066-561328d88ffb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:25.551354 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7d921220-6eb8-4856-a608-552931727786 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:25.551855 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7d921220-6eb8-4856-a608-552931727786 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:25.552703 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7d921220-6eb8-4856-a608-552931727786 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:25.553142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7d921220-6eb8-4856-a608-552931727786 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:25.565656 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ef52cbbc-fb4d-4d43-a066-561328d88ffb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:25.566416 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ef52cbbc-fb4d-4d43-a066-561328d88ffb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:25.567444 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ef52cbbc-fb4d-4d43-a066-561328d88ffb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:25.568013 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ef52cbbc-fb4d-4d43-a066-561328d88ffb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:25.681890 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ef52cbbc-fb4d-4d43-a066-561328d88ffb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003425f2d3474769b4f996f680088f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ad4b9bfe7941d3baa9c36cf551a874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:25.692022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ef52cbbc-fb4d-4d43-a066-561328d88ffb tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 200 len: 1346 microversion: 2.1 time: 0.164858 Feb 10 03:38:25.692825 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 101/201] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:25 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 1346 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:25.760776 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7d921220-6eb8-4856-a608-552931727786 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:25.768821 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7d921220-6eb8-4856-a608-552931727786 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.240790 Feb 10 03:38:25.769406 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 101/202] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:25 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:25.937900 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b368914e-5f34-4495-972e-3f76b6d644df tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:25.938920 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b368914e-5f34-4495-972e-3f76b6d644df tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:25.948042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b368914e-5f34-4495-972e-3f76b6d644df tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:25.948773 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b368914e-5f34-4495-972e-3f76b6d644df tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:25.949806 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b368914e-5f34-4495-972e-3f76b6d644df tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:25.950252 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b368914e-5f34-4495-972e-3f76b6d644df tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:26.154559 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b368914e-5f34-4495-972e-3f76b6d644df tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:26.167083 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b368914e-5f34-4495-972e-3f76b6d644df tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.233099 Feb 10 03:38:26.177316 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 102/203] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:25 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:26.709609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:26.710238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:26.716716 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:26.717177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:26.717963 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:26.718405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:26.733886 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] HTTP exception thrown: Instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce could not be found. Feb 10 03:38:26.734630 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Returning 404 to user: Instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:38:26.735520 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4dd84877-afb8-4004-a209-82f770d6c1da tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 404 len: 111 microversion: 2.1 time: 0.029933 Feb 10 03:38:26.736072 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 102/204] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:26 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:38:26.793008 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c5bbcb25-63ab-49dc-aa7d-41602ba6f328 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:26.793586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c5bbcb25-63ab-49dc-aa7d-41602ba6f328 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:26.800174 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c5bbcb25-63ab-49dc-aa7d-41602ba6f328 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:26.800860 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c5bbcb25-63ab-49dc-aa7d-41602ba6f328 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:26.801618 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c5bbcb25-63ab-49dc-aa7d-41602ba6f328 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:26.802032 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c5bbcb25-63ab-49dc-aa7d-41602ba6f328 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:26.845880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:26.847253 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:26.853552 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:26.854016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:26.854853 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:26.855292 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:26.868708 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] HTTP exception thrown: Instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce could not be found. Feb 10 03:38:26.869301 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Returning 404 to user: Instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:38:26.870304 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-97a64c39-b891-49db-adca-de3a0c416caf tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028643 Feb 10 03:38:26.871071 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 103/205] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:38:26 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 10 03:38:26.980020 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c5bbcb25-63ab-49dc-aa7d-41602ba6f328 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:26.989578 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c5bbcb25-63ab-49dc-aa7d-41602ba6f328 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.200197 Feb 10 03:38:26.999396 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 103/206] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:26 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:27.184492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f8baa088-7060-43a8-ac21-80df468a430b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:27.185106 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f8baa088-7060-43a8-ac21-80df468a430b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:27.191019 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f8baa088-7060-43a8-ac21-80df468a430b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:27.191548 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f8baa088-7060-43a8-ac21-80df468a430b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:27.192323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f8baa088-7060-43a8-ac21-80df468a430b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:27.192763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f8baa088-7060-43a8-ac21-80df468a430b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:27.332119 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f8baa088-7060-43a8-ac21-80df468a430b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:27.339880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f8baa088-7060-43a8-ac21-80df468a430b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.159160 Feb 10 03:38:27.340444 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 104/207] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:27 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:27.741371 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-0944e6a3-25c7-4e99-8ea1-6b7d043a19c9 req-0af804e4-05d7-4726-99d2-984558f01863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c3e5b6-954c-43c8-869e-194537294af8", "name": "network-vif-plugged", "status": "completed", "tag": "3e7a4b38-86d1-4977-a09a-05920db48467"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:27.746129 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:27.746129 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:38:27.758164 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-0944e6a3-25c7-4e99-8ea1-6b7d043a19c9 req-0af804e4-05d7-4726-99d2-984558f01863 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:27.758958 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-0944e6a3-25c7-4e99-8ea1-6b7d043a19c9 req-0af804e4-05d7-4726-99d2-984558f01863 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:27.775975 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-0944e6a3-25c7-4e99-8ea1-6b7d043a19c9 req-0af804e4-05d7-4726-99d2-984558f01863 service nova] Creating event network-vif-plugged:3e7a4b38-86d1-4977-a09a-05920db48467 for instance a6c3e5b6-954c-43c8-869e-194537294af8 on hv-cinder-82806 Feb 10 03:38:27.782188 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-0944e6a3-25c7-4e99-8ea1-6b7d043a19c9 req-0af804e4-05d7-4726-99d2-984558f01863 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046575 Feb 10 03:38:27.783825 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 104/208] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:28.007066 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-06aad3bd-541d-483b-ab79-d229c8387110 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:28.015885 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-06aad3bd-541d-483b-ab79-d229c8387110 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:28.026552 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-06aad3bd-541d-483b-ab79-d229c8387110 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:28.027242 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-06aad3bd-541d-483b-ab79-d229c8387110 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:28.028207 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-06aad3bd-541d-483b-ab79-d229c8387110 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:28.028933 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-06aad3bd-541d-483b-ab79-d229c8387110 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:28.120050 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:28.121743 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:28.130583 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:28.131321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:28.132490 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:28.133122 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:28.180301 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] HTTP exception thrown: Instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce could not be found. Feb 10 03:38:28.190956 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Returning 404 to user: Instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:38:28.192695 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-93a5c6e2-560a-456c-8f8d-6a0d1b00897f tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "DELETE /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 404 len: 111 microversion: 2.1 time: 0.079201 Feb 10 03:38:28.193650 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 105/209] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:38:28 2022] DELETE /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 10 03:38:28.210717 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:28.211313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] [instance: 84018c6b-a22d-4280-a1a2-e0f2c315c2ce] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:28.219593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:28.220215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:28.221195 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:28.222350 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:28.255064 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] HTTP exception thrown: Instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce could not be found. Feb 10 03:38:28.255838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] Returning 404 to user: Instance 84018c6b-a22d-4280-a1a2-e0f2c315c2ce could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:38:28.256664 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8b689007-6053-43b7-b7e6-1835fca532f3 tempest-DeleteServersTestJSON-632413604 tempest-DeleteServersTestJSON-632413604-project] 10.222.0.32 "GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce" status: 404 len: 111 microversion: 2.1 time: 0.057466 Feb 10 03:38:28.257530 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 106/210] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:28 2022] GET /compute/v2.1/servers/84018c6b-a22d-4280-a1a2-e0f2c315c2ce => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:38:28.354034 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-06aad3bd-541d-483b-ab79-d229c8387110 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:28.356526 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-cf64c3ce-0aa6-40bf-aa75-c711d0af8475 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:28.357145 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-cf64c3ce-0aa6-40bf-aa75-c711d0af8475 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:28.363469 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-06aad3bd-541d-483b-ab79-d229c8387110 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.360123 Feb 10 03:38:28.364579 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 105/211] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:28 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:28.374119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf64c3ce-0aa6-40bf-aa75-c711d0af8475 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:28.375322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf64c3ce-0aa6-40bf-aa75-c711d0af8475 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:28.377057 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf64c3ce-0aa6-40bf-aa75-c711d0af8475 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:28.378117 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cf64c3ce-0aa6-40bf-aa75-c711d0af8475 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:28.578346 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-cf64c3ce-0aa6-40bf-aa75-c711d0af8475 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:28.591527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-cf64c3ce-0aa6-40bf-aa75-c711d0af8475 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.238031 Feb 10 03:38:28.592480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 107/212] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:28 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:29.380829 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-50de0c3e-c5c9-4d33-8a48-5ea0cb826a40 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:29.382152 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-50de0c3e-c5c9-4d33-8a48-5ea0cb826a40 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:29.389631 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-50de0c3e-c5c9-4d33-8a48-5ea0cb826a40 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:29.390085 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-50de0c3e-c5c9-4d33-8a48-5ea0cb826a40 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:29.390901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-50de0c3e-c5c9-4d33-8a48-5ea0cb826a40 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:29.391512 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-50de0c3e-c5c9-4d33-8a48-5ea0cb826a40 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:29.609893 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f70fad9c-4346-429d-8d50-6f54f79c4f63 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:29.610918 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f70fad9c-4346-429d-8d50-6f54f79c4f63 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:29.619939 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f70fad9c-4346-429d-8d50-6f54f79c4f63 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:29.621096 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f70fad9c-4346-429d-8d50-6f54f79c4f63 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:29.622945 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f70fad9c-4346-429d-8d50-6f54f79c4f63 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:29.623267 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f70fad9c-4346-429d-8d50-6f54f79c4f63 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:29.659025 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-50de0c3e-c5c9-4d33-8a48-5ea0cb826a40 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:29.675756 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-50de0c3e-c5c9-4d33-8a48-5ea0cb826a40 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.298862 Feb 10 03:38:29.676884 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 106/213] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:29 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:29.873875 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-1e937c0c-28f5-4ced-92d8-0ffe6f1d5495 req-d96ef9c5-f176-4c11-a0d1-64fa7eb01acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5026c864-be6c-4702-bd77-88580b382ce7", "name": "network-vif-plugged", "status": "completed", "tag": "73b9af4c-1633-4ce7-bedf-db767aba25bf"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:29.875818 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:29.875818 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:29.893563 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-1e937c0c-28f5-4ced-92d8-0ffe6f1d5495 req-d96ef9c5-f176-4c11-a0d1-64fa7eb01acc service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:29.897970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-1e937c0c-28f5-4ced-92d8-0ffe6f1d5495 req-d96ef9c5-f176-4c11-a0d1-64fa7eb01acc service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:29.906902 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f70fad9c-4346-429d-8d50-6f54f79c4f63 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:29.918631 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f70fad9c-4346-429d-8d50-6f54f79c4f63 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1314 microversion: 2.1 time: 0.312484 Feb 10 03:38:29.929800 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 108/214] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:29 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:29.932329 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-1e937c0c-28f5-4ced-92d8-0ffe6f1d5495 req-d96ef9c5-f176-4c11-a0d1-64fa7eb01acc service nova] Creating event network-vif-plugged:73b9af4c-1633-4ce7-bedf-db767aba25bf for instance 5026c864-be6c-4702-bd77-88580b382ce7 on hv-cinder-82806 Feb 10 03:38:29.942927 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-1e937c0c-28f5-4ced-92d8-0ffe6f1d5495 req-d96ef9c5-f176-4c11-a0d1-64fa7eb01acc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073808 Feb 10 03:38:29.944308 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 107/215] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:38:30.693598 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b51982c5-8a0b-443d-8c72-4f1964fdeb4e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:30.694309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b51982c5-8a0b-443d-8c72-4f1964fdeb4e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:30.705172 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b51982c5-8a0b-443d-8c72-4f1964fdeb4e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:30.705821 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b51982c5-8a0b-443d-8c72-4f1964fdeb4e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:30.706709 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b51982c5-8a0b-443d-8c72-4f1964fdeb4e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:30.708101 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b51982c5-8a0b-443d-8c72-4f1964fdeb4e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:30.939384 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b111c8e9-d169-4e13-89c5-9f8af58d7a2e tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:30.941784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b111c8e9-d169-4e13-89c5-9f8af58d7a2e tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:30.951020 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b111c8e9-d169-4e13-89c5-9f8af58d7a2e tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:30.951757 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b111c8e9-d169-4e13-89c5-9f8af58d7a2e tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:30.953294 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b111c8e9-d169-4e13-89c5-9f8af58d7a2e tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:30.953954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b111c8e9-d169-4e13-89c5-9f8af58d7a2e tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:30.967961 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b51982c5-8a0b-443d-8c72-4f1964fdeb4e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:30.982560 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b51982c5-8a0b-443d-8c72-4f1964fdeb4e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1317 microversion: 2.1 time: 0.292398 Feb 10 03:38:30.987881 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 109/216] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:30 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:31.516624 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b111c8e9-d169-4e13-89c5-9f8af58d7a2e tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:31.553812 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b111c8e9-d169-4e13-89c5-9f8af58d7a2e tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1498 microversion: 2.1 time: 0.614923 Feb 10 03:38:31.557189 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 108/217] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:30 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1498 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:32.010158 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0f4fc32f-e8bb-4929-a62f-9359069030c7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:32.012051 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0f4fc32f-e8bb-4929-a62f-9359069030c7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:32.021949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f4fc32f-e8bb-4929-a62f-9359069030c7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.022391 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f4fc32f-e8bb-4929-a62f-9359069030c7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.030158 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f4fc32f-e8bb-4929-a62f-9359069030c7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.031110 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f4fc32f-e8bb-4929-a62f-9359069030c7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.440193 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0f4fc32f-e8bb-4929-a62f-9359069030c7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:32.451237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0f4fc32f-e8bb-4929-a62f-9359069030c7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1507 microversion: 2.1 time: 0.447289 Feb 10 03:38:32.455905 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 110/218] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:31 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:32.472526 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53bced8e-be60-480b-9ddd-b0a6cfb3fe19"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:32.473731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:32.488509 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.491663 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.497436 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.498891 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.532577 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b5b6c4d6-73b4-4e3f-9038-2ddee4071853 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:32.533337 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b5b6c4d6-73b4-4e3f-9038-2ddee4071853 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:32.545405 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b5b6c4d6-73b4-4e3f-9038-2ddee4071853 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.546111 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b5b6c4d6-73b4-4e3f-9038-2ddee4071853 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.547143 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b5b6c4d6-73b4-4e3f-9038-2ddee4071853 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.550001 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b5b6c4d6-73b4-4e3f-9038-2ddee4071853 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.644659 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b5b6c4d6-73b4-4e3f-9038-2ddee4071853 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:38:32.682538 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] HTTP exception thrown: Invalid volume: volume 53bced8e-be60-480b-9ddd-b0a6cfb3fe19 is already attached to instances: 28168573-b016-4c85-a32c-158c4155cd28 Feb 10 03:38:32.683484 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Returning 400 to user: Invalid volume: volume 53bced8e-be60-480b-9ddd-b0a6cfb3fe19 is already attached to instances: 28168573-b016-4c85-a32c-158c4155cd28 {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:38:32.684511 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-33f6d69e-2cae-4bcc-9072-54823da239e5 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.216415 Feb 10 03:38:32.685264 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 109/219] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:38:32 2022] POST /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7/os-volume_attachments => generated 174 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:38:32.830181 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-575bc58e-8cd8-465d-92c9-3b662ee83033 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:32.831023 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-575bc58e-8cd8-465d-92c9-3b662ee83033 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:32.851664 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-575bc58e-8cd8-465d-92c9-3b662ee83033 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.852070 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-575bc58e-8cd8-465d-92c9-3b662ee83033 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.858339 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-575bc58e-8cd8-465d-92c9-3b662ee83033 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.858852 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b5b6c4d6-73b4-4e3f-9038-2ddee4071853 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 204 len: 0 microversion: 2.1 time: 0.329663 Feb 10 03:38:32.859916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 111/220] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:38:32 2022] DELETE /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:38:32.863212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-575bc58e-8cd8-465d-92c9-3b662ee83033 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.869901 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-db98968b-76ab-482c-889f-9a6b53a2bed0 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:32.871921 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-db98968b-76ab-482c-889f-9a6b53a2bed0 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:32.886505 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-db98968b-76ab-482c-889f-9a6b53a2bed0 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.887378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-db98968b-76ab-482c-889f-9a6b53a2bed0 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:32.888382 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-db98968b-76ab-482c-889f-9a6b53a2bed0 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:32.888823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-db98968b-76ab-482c-889f-9a6b53a2bed0 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:33.127658 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-575bc58e-8cd8-465d-92c9-3b662ee83033 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lazy-loading 'services' on Instance uuid 28168573-b016-4c85-a32c-158c4155cd28 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:38:33.287342 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-db98968b-76ab-482c-889f-9a6b53a2bed0 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:33.299278 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-db98968b-76ab-482c-889f-9a6b53a2bed0 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1504 microversion: 2.1 time: 0.434361 Feb 10 03:38:33.311528 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 112/221] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:32 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:33.425162 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-575bc58e-8cd8-465d-92c9-3b662ee83033 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments/53bced8e-be60-480b-9ddd-b0a6cfb3fe19" status: 202 len: 0 microversion: 2.1 time: 0.602457 Feb 10 03:38:33.426204 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 110/222] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:38:32 2022] DELETE /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments/53bced8e-be60-480b-9ddd-b0a6cfb3fe19 => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:38:33.436216 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-577d3c0d-fadb-42f1-bf6b-e7f0f32dd1cf tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:33.437378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-577d3c0d-fadb-42f1-bf6b-e7f0f32dd1cf tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:33.453696 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-577d3c0d-fadb-42f1-bf6b-e7f0f32dd1cf tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:33.455951 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-577d3c0d-fadb-42f1-bf6b-e7f0f32dd1cf tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:33.461988 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-577d3c0d-fadb-42f1-bf6b-e7f0f32dd1cf tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:33.465743 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-577d3c0d-fadb-42f1-bf6b-e7f0f32dd1cf tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:33.568927 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-577d3c0d-fadb-42f1-bf6b-e7f0f32dd1cf tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136319 Feb 10 03:38:33.569724 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 113/223] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:38:33 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:34.328763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b9443103-4714-475d-9ed6-5b3badf87675 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:34.329459 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b9443103-4714-475d-9ed6-5b3badf87675 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:34.353988 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b9443103-4714-475d-9ed6-5b3badf87675 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:34.354833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b9443103-4714-475d-9ed6-5b3badf87675 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:34.355879 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b9443103-4714-475d-9ed6-5b3badf87675 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:34.357035 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b9443103-4714-475d-9ed6-5b3badf87675 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:34.583378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dd11264d-77bd-46f7-b66d-a8a927a5bbaa tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:34.585262 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dd11264d-77bd-46f7-b66d-a8a927a5bbaa tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:34.596987 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd11264d-77bd-46f7-b66d-a8a927a5bbaa tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:34.597544 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd11264d-77bd-46f7-b66d-a8a927a5bbaa tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:34.598427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd11264d-77bd-46f7-b66d-a8a927a5bbaa tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:34.599105 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd11264d-77bd-46f7-b66d-a8a927a5bbaa tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:34.663363 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dd11264d-77bd-46f7-b66d-a8a927a5bbaa tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086066 Feb 10 03:38:34.665770 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 114/224] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:38:34 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:38:34.700850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b9443103-4714-475d-9ed6-5b3badf87675 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:34.709054 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b9443103-4714-475d-9ed6-5b3badf87675 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1504 microversion: 2.1 time: 0.384515 Feb 10 03:38:34.709968 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 111/225] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:34 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:35.690084 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-20c790ec-d6a2-4638-9ee6-51cefc40c3b3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:35.691859 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-20c790ec-d6a2-4638-9ee6-51cefc40c3b3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:35.705990 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20c790ec-d6a2-4638-9ee6-51cefc40c3b3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:35.710438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20c790ec-d6a2-4638-9ee6-51cefc40c3b3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:35.711572 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20c790ec-d6a2-4638-9ee6-51cefc40c3b3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:35.712159 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20c790ec-d6a2-4638-9ee6-51cefc40c3b3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:35.727293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d73cef59-1309-40aa-af38-9caca1fa7d31 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:35.727914 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d73cef59-1309-40aa-af38-9caca1fa7d31 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:35.737649 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d73cef59-1309-40aa-af38-9caca1fa7d31 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:35.738102 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d73cef59-1309-40aa-af38-9caca1fa7d31 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:35.738945 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d73cef59-1309-40aa-af38-9caca1fa7d31 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:35.739382 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d73cef59-1309-40aa-af38-9caca1fa7d31 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:35.780090 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-20c790ec-d6a2-4638-9ee6-51cefc40c3b3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104284 Feb 10 03:38:35.784852 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 115/226] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:38:35 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:38:36.092037 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2010805980", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "4fceb00b-34fd-4a2b-b18c-a9d9c74a66d0"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:36.119731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d73cef59-1309-40aa-af38-9caca1fa7d31 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:36.129269 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d73cef59-1309-40aa-af38-9caca1fa7d31 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1504 microversion: 2.1 time: 0.404910 Feb 10 03:38:36.150485 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 112/227] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:35 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:36.190666 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] validate_networks() for [('4fceb00b-34fd-4a2b-b18c-a9d9c74a66d0', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:38:36.451250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-ff5c4766-451f-4ce3-aa8c-34818cc2e35b req-c08abb31-d02b-44b3-9d43-4b5c52e168e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c3e5b6-954c-43c8-869e-194537294af8", "name": "network-vif-deleted", "tag": "3e7a4b38-86d1-4977-a09a-05920db48467"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:36.453098 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:36.453098 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:36.468535 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-ff5c4766-451f-4ce3-aa8c-34818cc2e35b req-c08abb31-d02b-44b3-9d43-4b5c52e168e8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:36.469373 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-ff5c4766-451f-4ce3-aa8c-34818cc2e35b req-c08abb31-d02b-44b3-9d43-4b5c52e168e8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:36.484594 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-ff5c4766-451f-4ce3-aa8c-34818cc2e35b req-c08abb31-d02b-44b3-9d43-4b5c52e168e8 service nova] Creating event network-vif-deleted:3e7a4b38-86d1-4977-a09a-05920db48467 for instance a6c3e5b6-954c-43c8-869e-194537294af8 on hv-cinder-82806 Feb 10 03:38:36.504496 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-ff5c4766-451f-4ce3-aa8c-34818cc2e35b req-c08abb31-d02b-44b3-9d43-4b5c52e168e8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057603 Feb 10 03:38:36.505383 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 113/228] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:36.857995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:38:36.859112 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:38:36.859614 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:38:36.860023 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:38:36.860611 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:38:36.872412 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:36.872856 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:36.873657 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:36.874091 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:36.891712 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Getting quotas for project d7bf7bed71094487b57906e39d043543. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:36.896327 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Getting quotas for user 5adf0f1d005d4a1eb0136d4593b094b5 and project d7bf7bed71094487b57906e39d043543. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:36.909705 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:38:36.912161 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:38:36.975516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5a9779d7-d3be-4457-8cf8-4bce4ad7e396 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.887776 Feb 10 03:38:36.976849 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 116/229] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 10 03:38:36.988283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9ff6d024-b72d-4503-83dc-808640b28d62 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:36.988976 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9ff6d024-b72d-4503-83dc-808640b28d62 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:37.091207 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-9ff6d024-b72d-4503-83dc-808640b28d62 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:37.100462 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9ff6d024-b72d-4503-83dc-808640b28d62 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1218 microversion: 2.1 time: 0.116795 Feb 10 03:38:37.102404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 114/230] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:36 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:37.148098 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0183fb72-9095-4305-9aa0-30db3d097c17 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:37.149485 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0183fb72-9095-4305-9aa0-30db3d097c17 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:37.160454 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0183fb72-9095-4305-9aa0-30db3d097c17 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:37.161317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0183fb72-9095-4305-9aa0-30db3d097c17 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:37.162146 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0183fb72-9095-4305-9aa0-30db3d097c17 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:37.163782 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0183fb72-9095-4305-9aa0-30db3d097c17 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:37.279353 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0183fb72-9095-4305-9aa0-30db3d097c17 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:37.288246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0183fb72-9095-4305-9aa0-30db3d097c17 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1462 microversion: 2.1 time: 0.144275 Feb 10 03:38:37.290452 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 117/231] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:37 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1462 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:38.127266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-46401020-8b0e-4b4a-b0db-4f201044bdae tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:38.128345 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-46401020-8b0e-4b4a-b0db-4f201044bdae tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:38.145535 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-46401020-8b0e-4b4a-b0db-4f201044bdae tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:38.145900 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-46401020-8b0e-4b4a-b0db-4f201044bdae tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:38.146757 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-46401020-8b0e-4b4a-b0db-4f201044bdae tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:38.147180 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-46401020-8b0e-4b4a-b0db-4f201044bdae tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:38.298754 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-46401020-8b0e-4b4a-b0db-4f201044bdae tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:38.305597 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-987f747d-793f-4353-8680-20cc76504b13 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:38.306189 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-987f747d-793f-4353-8680-20cc76504b13 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:38.310183 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-46401020-8b0e-4b4a-b0db-4f201044bdae tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1222 microversion: 2.1 time: 0.195035 Feb 10 03:38:38.311419 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 115/232] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:38 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:38.321683 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-987f747d-793f-4353-8680-20cc76504b13 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:38.322847 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-987f747d-793f-4353-8680-20cc76504b13 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:38.326876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-987f747d-793f-4353-8680-20cc76504b13 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:38.329185 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-987f747d-793f-4353-8680-20cc76504b13 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:38.447021 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-987f747d-793f-4353-8680-20cc76504b13 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:38.459846 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-987f747d-793f-4353-8680-20cc76504b13 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 200 len: 1299 microversion: 2.1 time: 0.158115 Feb 10 03:38:38.462100 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 118/233] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:38 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:39.326513 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-844013de-de0a-40f2-a3b3-64d980de42ab tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:39.327178 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-844013de-de0a-40f2-a3b3-64d980de42ab tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:39.353912 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-844013de-de0a-40f2-a3b3-64d980de42ab tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:39.357172 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-844013de-de0a-40f2-a3b3-64d980de42ab tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:39.360491 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-844013de-de0a-40f2-a3b3-64d980de42ab tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:39.361568 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-844013de-de0a-40f2-a3b3-64d980de42ab tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:39.400173 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-199852476", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:39.497492 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-844013de-de0a-40f2-a3b3-64d980de42ab tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:39.515195 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-844013de-de0a-40f2-a3b3-64d980de42ab tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1270 microversion: 2.1 time: 0.190701 Feb 10 03:38:39.517681 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 119/234] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:39 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:39.525116 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:39.526320 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: a6c3e5b6-954c-43c8-869e-194537294af8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:39.538843 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] validate_networks() for [('e0aca2bf-c883-41b5-bca5-cb73801c5192', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:38:39.540094 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:39.540693 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:39.542124 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:39.542751 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:39.560290 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] HTTP exception thrown: Instance a6c3e5b6-954c-43c8-869e-194537294af8 could not be found. Feb 10 03:38:39.561152 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Returning 404 to user: Instance a6c3e5b6-954c-43c8-869e-194537294af8 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:38:39.562993 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0d4c9ab7-f871-41aa-a901-d31b72479224 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8" status: 404 len: 111 microversion: 2.1 time: 0.043452 Feb 10 03:38:39.564261 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 120/235] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:39 2022] GET /compute/v2.1/servers/a6c3e5b6-954c-43c8-869e-194537294af8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:38:39.758115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-237528392", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "76e22acc-1b00-4e17-aaca-a2a7c6c019ee"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:39.862736 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] validate_networks() for [('76e22acc-1b00-4e17-aaca-a2a7c6c019ee', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:38:41.557608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:38:41.558182 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:38:41.558513 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:38:41.559181 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:38:41.559591 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:38:41.578589 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:41.579441 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:41.580370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:41.582080 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:41.636907 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Getting quotas for project b5f20a9d15eb4d99bf667578a36a9f55. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:41.646402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Getting quotas for user 30c4ac1332b64a648d7214918f757f83 and project b5f20a9d15eb4d99bf667578a36a9f55. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:41.647545 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:38:41.648194 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:38:41.650100 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:38:41.650751 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:38:41.651488 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:38:41.674714 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:41.681156 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:41.683773 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:41.691106 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:41.696681 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:38:41.706818 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:38:41.770260 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Getting quotas for project 114e0c095df64647bf339f0e8dcf8571. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:41.784731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Getting quotas for user ddab0c5f110c41eba9629f8020db02fa and project 114e0c095df64647bf339f0e8dcf8571. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:41.820407 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:38:41.830232 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:38:41.847601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ccfdeae2-2bb2-4307-b7b2-d13825eaa5d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.093322 Feb 10 03:38:41.848837 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 121/236] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:38:41.854274 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dea543e4-bfd1-498f-8432-741b8bb91435 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:41.855234 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dea543e4-bfd1-498f-8432-741b8bb91435 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:41.862209 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dea543e4-bfd1-498f-8432-741b8bb91435 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:41.862929 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dea543e4-bfd1-498f-8432-741b8bb91435 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:41.864218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dea543e4-bfd1-498f-8432-741b8bb91435 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:41.864916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dea543e4-bfd1-498f-8432-741b8bb91435 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:41.951894 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-85669825-ccf2-4533-b182-7547af03cbf4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.772042 Feb 10 03:38:41.952944 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 116/237] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:38:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:38:41.967336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b7af008e-3209-444a-a7ba-5598258e4162 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:41.968993 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b7af008e-3209-444a-a7ba-5598258e4162 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:42.186028 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b7af008e-3209-444a-a7ba-5598258e4162 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:42.220609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b7af008e-3209-444a-a7ba-5598258e4162 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1213 microversion: 2.1 time: 0.258629 Feb 10 03:38:42.221752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 117/238] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:41 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1213 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:42.231561 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b2ecd7e2-4c3e-4c99-9ba3-1e5eea9340c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:42.250721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b2ecd7e2-4c3e-4c99-9ba3-1e5eea9340c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:42.334980 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dea543e4-bfd1-498f-8432-741b8bb91435 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:42.344393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dea543e4-bfd1-498f-8432-741b8bb91435 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1276 microversion: 2.1 time: 0.494264 Feb 10 03:38:42.346545 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 122/239] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:41 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1276 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:42.470133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b2ecd7e2-4c3e-4c99-9ba3-1e5eea9340c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:42.479288 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b2ecd7e2-4c3e-4c99-9ba3-1e5eea9340c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1221 microversion: 2.1 time: 0.251205 Feb 10 03:38:42.480112 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 118/240] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:42 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1221 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:42.568747 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-57214914", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:42.699408 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] validate_networks() for [('e0aca2bf-c883-41b5-bca5-cb73801c5192', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:38:43.238012 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-8b80042c-d165-4138-af7e-51210625fc0f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:43.238618 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8b80042c-d165-4138-af7e-51210625fc0f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:43.254854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8b80042c-d165-4138-af7e-51210625fc0f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:43.256709 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8b80042c-d165-4138-af7e-51210625fc0f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:43.258588 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8b80042c-d165-4138-af7e-51210625fc0f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:43.260455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8b80042c-d165-4138-af7e-51210625fc0f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:43.454815 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-8b80042c-d165-4138-af7e-51210625fc0f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:43.480231 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-8b80042c-d165-4138-af7e-51210625fc0f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1265 microversion: 2.1 time: 0.246574 Feb 10 03:38:43.481968 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 119/241] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:43 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:43.505918 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e14fb7e7-0ef3-431d-8f46-cef2a418c4ac tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:43.508443 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e14fb7e7-0ef3-431d-8f46-cef2a418c4ac tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:43.525432 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e14fb7e7-0ef3-431d-8f46-cef2a418c4ac tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:43.527238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e14fb7e7-0ef3-431d-8f46-cef2a418c4ac tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:43.533320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e14fb7e7-0ef3-431d-8f46-cef2a418c4ac tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:43.534928 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e14fb7e7-0ef3-431d-8f46-cef2a418c4ac tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:44.057356 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:38:44.057940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:38:44.058227 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:38:44.058633 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:38:44.059065 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:38:44.084358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:44.084874 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:44.085724 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:44.086161 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:44.135613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Getting quotas for project 114e0c095df64647bf339f0e8dcf8571. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:44.164327 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Getting quotas for user ddab0c5f110c41eba9629f8020db02fa and project 114e0c095df64647bf339f0e8dcf8571. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:44.206807 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:38:44.209177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:38:44.340918 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3cc62b51-72a7-4ac6-aa81-3a6cbcf59d9b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.777089 Feb 10 03:38:44.341495 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 123/242] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:38:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:38:44.355046 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-411f1b36-2f56-46a2-b413-fe124bced1fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:44.366484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-411f1b36-2f56-46a2-b413-fe124bced1fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:44.368348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e14fb7e7-0ef3-431d-8f46-cef2a418c4ac tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:44.381081 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e14fb7e7-0ef3-431d-8f46-cef2a418c4ac tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.896479 Feb 10 03:38:44.383357 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 120/243] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:43 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:44.501458 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-cc6f25b9-7ae6-449a-b74d-c156d8c481d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:44.501829 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-cc6f25b9-7ae6-449a-b74d-c156d8c481d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:44.515484 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cc6f25b9-7ae6-449a-b74d-c156d8c481d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:44.516135 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cc6f25b9-7ae6-449a-b74d-c156d8c481d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:44.519647 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cc6f25b9-7ae6-449a-b74d-c156d8c481d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:44.522027 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cc6f25b9-7ae6-449a-b74d-c156d8c481d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:44.590540 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-411f1b36-2f56-46a2-b413-fe124bced1fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:44.625581 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-411f1b36-2f56-46a2-b413-fe124bced1fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1220 microversion: 2.1 time: 0.277256 Feb 10 03:38:44.626168 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 124/244] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:44 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1220 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:44.772993 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cc6f25b9-7ae6-449a-b74d-c156d8c481d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:44.785237 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-cc6f25b9-7ae6-449a-b74d-c156d8c481d9 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1271 microversion: 2.1 time: 0.287385 Feb 10 03:38:44.792428 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 121/245] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:44 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1271 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:44.932185 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-bc2290ee-6986-4fe3-bb1c-8186bf782938 req-13eefa07-680e-4125-b923-c691a0e40720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0296ee2e-4bd2-4e13-864a-6c80f1b54bf3", "tag": "53940bd9-b20a-45d0-989c-c2c1a1dd9c69"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:44.933811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:44.933811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:38:44.977963 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-bc2290ee-6986-4fe3-bb1c-8186bf782938 req-13eefa07-680e-4125-b923-c691a0e40720 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:44.980935 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-bc2290ee-6986-4fe3-bb1c-8186bf782938 req-13eefa07-680e-4125-b923-c691a0e40720 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:45.031373 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-bc2290ee-6986-4fe3-bb1c-8186bf782938 req-13eefa07-680e-4125-b923-c691a0e40720 service nova] Creating event network-changed:53940bd9-b20a-45d0-989c-c2c1a1dd9c69 for instance 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 on hv-cinder-82806 Feb 10 03:38:45.040478 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-bc2290ee-6986-4fe3-bb1c-8186bf782938 req-13eefa07-680e-4125-b923-c691a0e40720 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111892 Feb 10 03:38:45.045924 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 125/246] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:45.411676 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e460172d-6f38-4fd5-a6af-99f9b2200d17 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:45.412994 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e460172d-6f38-4fd5-a6af-99f9b2200d17 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:45.428538 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e460172d-6f38-4fd5-a6af-99f9b2200d17 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:45.441582 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e460172d-6f38-4fd5-a6af-99f9b2200d17 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:45.442898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e460172d-6f38-4fd5-a6af-99f9b2200d17 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:45.443501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e460172d-6f38-4fd5-a6af-99f9b2200d17 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:45.646052 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f2bf2843-3a3c-49f7-9ffa-e9d16f4307a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:45.646890 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f2bf2843-3a3c-49f7-9ffa-e9d16f4307a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:45.675492 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f2bf2843-3a3c-49f7-9ffa-e9d16f4307a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:45.676121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f2bf2843-3a3c-49f7-9ffa-e9d16f4307a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:45.676989 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f2bf2843-3a3c-49f7-9ffa-e9d16f4307a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:45.680176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f2bf2843-3a3c-49f7-9ffa-e9d16f4307a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:45.822368 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f2bf2843-3a3c-49f7-9ffa-e9d16f4307a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:45.833933 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f2bf2843-3a3c-49f7-9ffa-e9d16f4307a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1272 microversion: 2.1 time: 0.195457 Feb 10 03:38:45.835143 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 126/247] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:45 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:45.840889 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f8aba61e-a1eb-4f50-9c26-4611978c71e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:45.841470 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f8aba61e-a1eb-4f50-9c26-4611978c71e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:45.858368 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f8aba61e-a1eb-4f50-9c26-4611978c71e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:45.861044 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f8aba61e-a1eb-4f50-9c26-4611978c71e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:45.861935 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f8aba61e-a1eb-4f50-9c26-4611978c71e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:45.862380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f8aba61e-a1eb-4f50-9c26-4611978c71e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:46.014056 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f8aba61e-a1eb-4f50-9c26-4611978c71e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:46.031003 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f8aba61e-a1eb-4f50-9c26-4611978c71e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1271 microversion: 2.1 time: 0.190134 Feb 10 03:38:46.041484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 127/248] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:45 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:46.041812 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e460172d-6f38-4fd5-a6af-99f9b2200d17 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:46.048878 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e460172d-6f38-4fd5-a6af-99f9b2200d17 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.641471 Feb 10 03:38:46.049901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 122/249] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:45 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:46.852025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c107db0c-95a0-4b56-8562-3436e0cf80ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:46.853306 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c107db0c-95a0-4b56-8562-3436e0cf80ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:46.868379 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c107db0c-95a0-4b56-8562-3436e0cf80ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:46.870310 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c107db0c-95a0-4b56-8562-3436e0cf80ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:46.871857 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c107db0c-95a0-4b56-8562-3436e0cf80ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:46.873485 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c107db0c-95a0-4b56-8562-3436e0cf80ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:47.036380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c107db0c-95a0-4b56-8562-3436e0cf80ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:47.048933 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-775673e2-f093-4cd0-baa1-01df53487f0a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:47.050341 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-775673e2-f093-4cd0-baa1-01df53487f0a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:47.055551 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c107db0c-95a0-4b56-8562-3436e0cf80ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1278 microversion: 2.1 time: 0.207959 Feb 10 03:38:47.056149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 128/250] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:46 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:47.068007 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a183e72b-4004-46da-a796-599d94aa8ba8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:47.071040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-775673e2-f093-4cd0-baa1-01df53487f0a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:47.071550 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-775673e2-f093-4cd0-baa1-01df53487f0a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:47.072460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-775673e2-f093-4cd0-baa1-01df53487f0a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:47.072839 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-775673e2-f093-4cd0-baa1-01df53487f0a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:47.073923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a183e72b-4004-46da-a796-599d94aa8ba8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:47.094150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a183e72b-4004-46da-a796-599d94aa8ba8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:47.094150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a183e72b-4004-46da-a796-599d94aa8ba8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:47.098681 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a183e72b-4004-46da-a796-599d94aa8ba8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:47.100920 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a183e72b-4004-46da-a796-599d94aa8ba8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:47.317370 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-775673e2-f093-4cd0-baa1-01df53487f0a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:47.325103 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-775673e2-f093-4cd0-baa1-01df53487f0a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1271 microversion: 2.1 time: 0.279752 Feb 10 03:38:47.325688 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 123/251] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:47 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:47.657368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dd6efefb-7e18-40bb-bc8d-8ee44a7b4afb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Action: 'create', calling method: .version_select at 0x7fe95a5870d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1051863551"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:47.660456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a183e72b-4004-46da-a796-599d94aa8ba8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:47.676520 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a183e72b-4004-46da-a796-599d94aa8ba8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.614891 Feb 10 03:38:47.683389 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-dd6efefb-7e18-40bb-bc8d-8ee44a7b4afb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for project 9861d9e039084b9b9b24721464eea6e6. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:47.689872 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-dd6efefb-7e18-40bb-bc8d-8ee44a7b4afb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for user 1521bf93314c437798ef374963def38e and project 9861d9e039084b9b9b24721464eea6e6. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:47.691838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 129/252] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:47 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:47.908348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-dd6efefb-7e18-40bb-bc8d-8ee44a7b4afb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for project 9861d9e039084b9b9b24721464eea6e6. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:38:47.914800 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-dd6efefb-7e18-40bb-bc8d-8ee44a7b4afb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for user 1521bf93314c437798ef374963def38e and project 9861d9e039084b9b9b24721464eea6e6. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:38:47.933997 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dd6efefb-7e18-40bb-bc8d-8ee44a7b4afb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.595281 Feb 10 03:38:47.940408 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 124/253] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Feb 10 03:38:47 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:48.072484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0aa6c2b4-1971-4f71-a56d-62d01d84d701 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:48.073255 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0aa6c2b4-1971-4f71-a56d-62d01d84d701 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:48.081792 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0aa6c2b4-1971-4f71-a56d-62d01d84d701 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:48.082273 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0aa6c2b4-1971-4f71-a56d-62d01d84d701 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:48.083063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0aa6c2b4-1971-4f71-a56d-62d01d84d701 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:48.083493 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0aa6c2b4-1971-4f71-a56d-62d01d84d701 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:48.230823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0aa6c2b4-1971-4f71-a56d-62d01d84d701 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:48.242893 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0aa6c2b4-1971-4f71-a56d-62d01d84d701 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1278 microversion: 2.1 time: 0.173541 Feb 10 03:38:48.243938 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 130/254] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:48 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:48.343613 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4a8cbd37-3ed3-4557-b616-9ddb9e20efde tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:48.344514 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4a8cbd37-3ed3-4557-b616-9ddb9e20efde tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:48.362477 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4a8cbd37-3ed3-4557-b616-9ddb9e20efde tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:48.363363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4a8cbd37-3ed3-4557-b616-9ddb9e20efde tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:48.364388 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4a8cbd37-3ed3-4557-b616-9ddb9e20efde tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:48.365007 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4a8cbd37-3ed3-4557-b616-9ddb9e20efde tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:48.695504 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5c319b80-3437-471c-97c0-6409f07f8891 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:48.698818 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5c319b80-3437-471c-97c0-6409f07f8891 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:48.705371 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5c319b80-3437-471c-97c0-6409f07f8891 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:48.706124 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5c319b80-3437-471c-97c0-6409f07f8891 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:48.707117 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5c319b80-3437-471c-97c0-6409f07f8891 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:48.707702 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5c319b80-3437-471c-97c0-6409f07f8891 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:48.743919 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4a8cbd37-3ed3-4557-b616-9ddb9e20efde tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:48.757164 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4a8cbd37-3ed3-4557-b616-9ddb9e20efde tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.419272 Feb 10 03:38:48.757758 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 125/255] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:48 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:49.050903 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5c319b80-3437-471c-97c0-6409f07f8891 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:49.074373 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5c319b80-3437-471c-97c0-6409f07f8891 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.381493 Feb 10 03:38:49.077117 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 131/256] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:48 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:49.261616 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f2f75302-533c-4d46-b8be-0fc514e623b0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:49.263568 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f2f75302-533c-4d46-b8be-0fc514e623b0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:49.274733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2f75302-533c-4d46-b8be-0fc514e623b0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:49.275203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2f75302-533c-4d46-b8be-0fc514e623b0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:49.276112 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2f75302-533c-4d46-b8be-0fc514e623b0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:49.276591 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2f75302-533c-4d46-b8be-0fc514e623b0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:49.359139 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-bc6b3457-4bfa-4e3a-b256-69ab6dc9827a req-8c686bcd-9253-4bcc-bc95-2128efbd6257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "699b7ed3-80f5-47d0-bcec-6801073102d6", "tag": "1de8a500-64d0-4173-8581-65530f888f8a"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:49.360803 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:49.360803 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:38:49.377780 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-bc6b3457-4bfa-4e3a-b256-69ab6dc9827a req-8c686bcd-9253-4bcc-bc95-2128efbd6257 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:49.378599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-bc6b3457-4bfa-4e3a-b256-69ab6dc9827a req-8c686bcd-9253-4bcc-bc95-2128efbd6257 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:49.397203 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-bc6b3457-4bfa-4e3a-b256-69ab6dc9827a req-8c686bcd-9253-4bcc-bc95-2128efbd6257 service nova] Creating event network-changed:1de8a500-64d0-4173-8581-65530f888f8a for instance 699b7ed3-80f5-47d0-bcec-6801073102d6 on hv-cinder-82806 Feb 10 03:38:49.407850 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-bc6b3457-4bfa-4e3a-b256-69ab6dc9827a req-8c686bcd-9253-4bcc-bc95-2128efbd6257 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054603 Feb 10 03:38:49.408463 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 132/257] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:38:49.658821 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f2f75302-533c-4d46-b8be-0fc514e623b0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:49.673493 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f2f75302-533c-4d46-b8be-0fc514e623b0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.415884 Feb 10 03:38:49.677836 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 126/258] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:49 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:49.781820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e35e435c-6aec-4742-aeb8-dfe07b0afbc2 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:49.782846 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e35e435c-6aec-4742-aeb8-dfe07b0afbc2 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:49.796071 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e35e435c-6aec-4742-aeb8-dfe07b0afbc2 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:49.796986 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e35e435c-6aec-4742-aeb8-dfe07b0afbc2 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:49.798416 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e35e435c-6aec-4742-aeb8-dfe07b0afbc2 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:49.799766 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e35e435c-6aec-4742-aeb8-dfe07b0afbc2 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:50.045235 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e35e435c-6aec-4742-aeb8-dfe07b0afbc2 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:50.058838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e35e435c-6aec-4742-aeb8-dfe07b0afbc2 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.287483 Feb 10 03:38:50.060115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 133/259] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:49 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:50.093772 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c74928b5-15f4-4537-8305-fc43cf553f23 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:50.095119 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c74928b5-15f4-4537-8305-fc43cf553f23 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:50.101663 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c74928b5-15f4-4537-8305-fc43cf553f23 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:50.102450 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c74928b5-15f4-4537-8305-fc43cf553f23 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:50.103563 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c74928b5-15f4-4537-8305-fc43cf553f23 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:50.104276 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c74928b5-15f4-4537-8305-fc43cf553f23 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:50.330815 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c74928b5-15f4-4537-8305-fc43cf553f23 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:50.339052 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c74928b5-15f4-4537-8305-fc43cf553f23 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.250382 Feb 10 03:38:50.347525 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 127/260] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:50 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:50.696393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e7ac3ccb-46b3-4f6d-bbce-cae2c7dc4989 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:50.696987 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e7ac3ccb-46b3-4f6d-bbce-cae2c7dc4989 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:50.703301 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7ac3ccb-46b3-4f6d-bbce-cae2c7dc4989 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:50.703918 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7ac3ccb-46b3-4f6d-bbce-cae2c7dc4989 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:50.704605 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7ac3ccb-46b3-4f6d-bbce-cae2c7dc4989 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:50.705214 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7ac3ccb-46b3-4f6d-bbce-cae2c7dc4989 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:50.861164 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e7ac3ccb-46b3-4f6d-bbce-cae2c7dc4989 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:50.871988 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e7ac3ccb-46b3-4f6d-bbce-cae2c7dc4989 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.178632 Feb 10 03:38:50.872741 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 134/261] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:50 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:51.075827 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f4af3451-eaa7-4168-83bb-0a061e3d44e7 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:51.076746 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f4af3451-eaa7-4168-83bb-0a061e3d44e7 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:51.083516 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f4af3451-eaa7-4168-83bb-0a061e3d44e7 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:51.083971 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f4af3451-eaa7-4168-83bb-0a061e3d44e7 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:51.084929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f4af3451-eaa7-4168-83bb-0a061e3d44e7 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:51.085489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f4af3451-eaa7-4168-83bb-0a061e3d44e7 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:51.372873 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5e1fd8f7-7790-49ee-ba3b-25d48c7bc995 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:51.373503 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5e1fd8f7-7790-49ee-ba3b-25d48c7bc995 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:51.383411 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5e1fd8f7-7790-49ee-ba3b-25d48c7bc995 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:51.387349 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5e1fd8f7-7790-49ee-ba3b-25d48c7bc995 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:51.390857 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5e1fd8f7-7790-49ee-ba3b-25d48c7bc995 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:51.392884 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5e1fd8f7-7790-49ee-ba3b-25d48c7bc995 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:51.583931 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f4af3451-eaa7-4168-83bb-0a061e3d44e7 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:51.591984 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f4af3451-eaa7-4168-83bb-0a061e3d44e7 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.519797 Feb 10 03:38:51.601666 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 128/262] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:51 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:51.608827 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-6537ebf1-5ea0-4042-96b1-a78a50426b3c req-628d6bad-a5d6-4058-978f-0217dafad452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea", "tag": "e19c2120-4b2b-405d-943c-f5030818eca4"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:51.610522 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:51.610522 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:51.637769 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-6537ebf1-5ea0-4042-96b1-a78a50426b3c req-628d6bad-a5d6-4058-978f-0217dafad452 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:51.639029 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-6537ebf1-5ea0-4042-96b1-a78a50426b3c req-628d6bad-a5d6-4058-978f-0217dafad452 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:51.664734 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-6537ebf1-5ea0-4042-96b1-a78a50426b3c req-628d6bad-a5d6-4058-978f-0217dafad452 service nova] Creating event network-changed:e19c2120-4b2b-405d-943c-f5030818eca4 for instance 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea on hv-cinder-82806 Feb 10 03:38:51.690176 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-6537ebf1-5ea0-4042-96b1-a78a50426b3c req-628d6bad-a5d6-4058-978f-0217dafad452 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086339 Feb 10 03:38:51.691950 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 129/263] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:51.876003 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5e1fd8f7-7790-49ee-ba3b-25d48c7bc995 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:51.890338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5e1fd8f7-7790-49ee-ba3b-25d48c7bc995 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.528480 Feb 10 03:38:51.891294 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a3a6bfe4-0544-44ef-8c39-8cf878b51bea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:51.891577 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 135/264] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:51 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:51.893171 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a3a6bfe4-0544-44ef-8c39-8cf878b51bea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:51.918482 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a3a6bfe4-0544-44ef-8c39-8cf878b51bea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:51.920996 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a3a6bfe4-0544-44ef-8c39-8cf878b51bea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:51.922496 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a3a6bfe4-0544-44ef-8c39-8cf878b51bea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:51.924190 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a3a6bfe4-0544-44ef-8c39-8cf878b51bea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:52.395688 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a3a6bfe4-0544-44ef-8c39-8cf878b51bea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:52.410761 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a3a6bfe4-0544-44ef-8c39-8cf878b51bea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.524096 Feb 10 03:38:52.411780 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 130/265] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:51 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:52.608601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-890a3872-97d2-46eb-98ee-709a1acd5652 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:52.609947 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-890a3872-97d2-46eb-98ee-709a1acd5652 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:52.617004 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-890a3872-97d2-46eb-98ee-709a1acd5652 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:52.617456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-890a3872-97d2-46eb-98ee-709a1acd5652 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:52.618251 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-890a3872-97d2-46eb-98ee-709a1acd5652 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:52.618869 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-890a3872-97d2-46eb-98ee-709a1acd5652 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:52.821224 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-4702e46a-60ad-4606-9ce1-53d14fc06a6e req-64b1a12f-b8e9-449d-9784-d5b634311291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b92fc0-cfd3-4eb0-a15e-5d0558d253a9", "tag": "fafc4667-568b-4a5e-9472-26cc6a82e44a"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:52.833977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:52.833977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:52.853954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-4702e46a-60ad-4606-9ce1-53d14fc06a6e req-64b1a12f-b8e9-449d-9784-d5b634311291 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:52.854939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-4702e46a-60ad-4606-9ce1-53d14fc06a6e req-64b1a12f-b8e9-449d-9784-d5b634311291 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:52.878146 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-4702e46a-60ad-4606-9ce1-53d14fc06a6e req-64b1a12f-b8e9-449d-9784-d5b634311291 service nova] Creating event network-changed:fafc4667-568b-4a5e-9472-26cc6a82e44a for instance 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 on hv-cinder-82806 Feb 10 03:38:52.885385 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-4702e46a-60ad-4606-9ce1-53d14fc06a6e req-64b1a12f-b8e9-449d-9784-d5b634311291 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073684 Feb 10 03:38:52.887012 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 131/266] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:52.915948 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3cfc1ad8-bac8-490e-b8cf-835e78936d7e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:52.916841 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3cfc1ad8-bac8-490e-b8cf-835e78936d7e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:52.924436 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3cfc1ad8-bac8-490e-b8cf-835e78936d7e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:52.924869 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3cfc1ad8-bac8-490e-b8cf-835e78936d7e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:52.926967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3cfc1ad8-bac8-490e-b8cf-835e78936d7e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:52.927663 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3cfc1ad8-bac8-490e-b8cf-835e78936d7e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:52.992401 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-890a3872-97d2-46eb-98ee-709a1acd5652 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:53.017763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-890a3872-97d2-46eb-98ee-709a1acd5652 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.409560 Feb 10 03:38:53.018519 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 136/267] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:52 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:53.298515 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3cfc1ad8-bac8-490e-b8cf-835e78936d7e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:53.306330 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3cfc1ad8-bac8-490e-b8cf-835e78936d7e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.401933 Feb 10 03:38:53.307172 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 132/268] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:52 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:53.434493 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1476954e-2edc-4481-b494-431fc3ff8e7d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:53.439489 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1476954e-2edc-4481-b494-431fc3ff8e7d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:53.482066 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1476954e-2edc-4481-b494-431fc3ff8e7d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:53.483481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1476954e-2edc-4481-b494-431fc3ff8e7d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:53.484557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1476954e-2edc-4481-b494-431fc3ff8e7d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:53.485365 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1476954e-2edc-4481-b494-431fc3ff8e7d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:53.533229 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-851627bb-d59d-4074-b3df-c51bde51ad99 req-74047582-b853-4e82-9ff5-dd6e1f9b225a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0296ee2e-4bd2-4e13-864a-6c80f1b54bf3", "name": "network-vif-plugged", "status": "completed", "tag": "53940bd9-b20a-45d0-989c-c2c1a1dd9c69"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:53.535804 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:53.535804 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:53.543578 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-851627bb-d59d-4074-b3df-c51bde51ad99 req-74047582-b853-4e82-9ff5-dd6e1f9b225a service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:53.544254 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-851627bb-d59d-4074-b3df-c51bde51ad99 req-74047582-b853-4e82-9ff5-dd6e1f9b225a service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:53.556236 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-851627bb-d59d-4074-b3df-c51bde51ad99 req-74047582-b853-4e82-9ff5-dd6e1f9b225a service nova] Creating event network-vif-plugged:53940bd9-b20a-45d0-989c-c2c1a1dd9c69 for instance 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 on hv-cinder-82806 Feb 10 03:38:53.561636 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-851627bb-d59d-4074-b3df-c51bde51ad99 req-74047582-b853-4e82-9ff5-dd6e1f9b225a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032051 Feb 10 03:38:53.562990 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 133/269] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:53.667785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1476954e-2edc-4481-b494-431fc3ff8e7d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:53.682161 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1476954e-2edc-4481-b494-431fc3ff8e7d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.255443 Feb 10 03:38:53.683350 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 137/270] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:53 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:54.051240 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9ce6cbca-9bae-4385-bc0c-10d7c617c15a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:54.051954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9ce6cbca-9bae-4385-bc0c-10d7c617c15a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:54.065598 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9ce6cbca-9bae-4385-bc0c-10d7c617c15a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:54.066341 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9ce6cbca-9bae-4385-bc0c-10d7c617c15a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:54.067376 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9ce6cbca-9bae-4385-bc0c-10d7c617c15a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:54.067996 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9ce6cbca-9bae-4385-bc0c-10d7c617c15a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:54.323537 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6fabac58-d48a-4e1e-b80d-e1ab3a58bbc0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:54.324221 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6fabac58-d48a-4e1e-b80d-e1ab3a58bbc0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:54.331216 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6fabac58-d48a-4e1e-b80d-e1ab3a58bbc0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:54.331896 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6fabac58-d48a-4e1e-b80d-e1ab3a58bbc0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:54.332689 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6fabac58-d48a-4e1e-b80d-e1ab3a58bbc0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:54.333122 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6fabac58-d48a-4e1e-b80d-e1ab3a58bbc0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:54.365317 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-9ce6cbca-9bae-4385-bc0c-10d7c617c15a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:54.373119 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9ce6cbca-9bae-4385-bc0c-10d7c617c15a tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.331891 Feb 10 03:38:54.374336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 134/271] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:54 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:54.519239 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6fabac58-d48a-4e1e-b80d-e1ab3a58bbc0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:54.527696 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6fabac58-d48a-4e1e-b80d-e1ab3a58bbc0 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.207750 Feb 10 03:38:54.528726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 138/272] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:54 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:54.699841 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-aa7444cd-3a7e-44cc-b0e4-2fcc57d00f5d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:54.700489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-aa7444cd-3a7e-44cc-b0e4-2fcc57d00f5d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:54.706568 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-aa7444cd-3a7e-44cc-b0e4-2fcc57d00f5d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:54.707051 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-aa7444cd-3a7e-44cc-b0e4-2fcc57d00f5d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:54.707991 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-aa7444cd-3a7e-44cc-b0e4-2fcc57d00f5d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:54.708481 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-aa7444cd-3a7e-44cc-b0e4-2fcc57d00f5d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:54.874294 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-aa7444cd-3a7e-44cc-b0e4-2fcc57d00f5d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:54.882873 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-aa7444cd-3a7e-44cc-b0e4-2fcc57d00f5d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.187373 Feb 10 03:38:54.883451 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 135/273] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:54 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:55.390688 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3691a0ae-f131-4ba9-ba07-6ce5e23e7cef tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:55.391334 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3691a0ae-f131-4ba9-ba07-6ce5e23e7cef tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:55.398342 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3691a0ae-f131-4ba9-ba07-6ce5e23e7cef tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:55.398824 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3691a0ae-f131-4ba9-ba07-6ce5e23e7cef tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:55.399617 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3691a0ae-f131-4ba9-ba07-6ce5e23e7cef tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:55.400234 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3691a0ae-f131-4ba9-ba07-6ce5e23e7cef tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:55.545179 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1801a6fc-f08a-47c7-bd77-421299e25c72 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:55.546229 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1801a6fc-f08a-47c7-bd77-421299e25c72 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:55.555427 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1801a6fc-f08a-47c7-bd77-421299e25c72 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:55.555883 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1801a6fc-f08a-47c7-bd77-421299e25c72 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:55.557181 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1801a6fc-f08a-47c7-bd77-421299e25c72 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:55.558197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1801a6fc-f08a-47c7-bd77-421299e25c72 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:55.559991 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3691a0ae-f131-4ba9-ba07-6ce5e23e7cef tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:55.568661 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3691a0ae-f131-4ba9-ba07-6ce5e23e7cef tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.181626 Feb 10 03:38:55.569307 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 139/274] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:55 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:55.749418 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1801a6fc-f08a-47c7-bd77-421299e25c72 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:55.757856 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1801a6fc-f08a-47c7-bd77-421299e25c72 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1318 microversion: 2.1 time: 0.216596 Feb 10 03:38:55.759350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 136/275] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:55 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:38:55.899483 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-9e0f7944-384d-42fa-a0db-1f53244364c2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:55.900160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9e0f7944-384d-42fa-a0db-1f53244364c2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:55.909004 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9e0f7944-384d-42fa-a0db-1f53244364c2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:55.910154 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9e0f7944-384d-42fa-a0db-1f53244364c2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:55.911052 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9e0f7944-384d-42fa-a0db-1f53244364c2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:55.911561 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9e0f7944-384d-42fa-a0db-1f53244364c2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:56.082298 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-9e0f7944-384d-42fa-a0db-1f53244364c2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:56.090213 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-9e0f7944-384d-42fa-a0db-1f53244364c2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.194442 Feb 10 03:38:56.090835 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 140/276] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:55 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:56.586231 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-87d697cf-e8dc-4117-8c02-a6f9414faa23 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:56.586941 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-87d697cf-e8dc-4117-8c02-a6f9414faa23 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:56.593795 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87d697cf-e8dc-4117-8c02-a6f9414faa23 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:56.594238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87d697cf-e8dc-4117-8c02-a6f9414faa23 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:56.595030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87d697cf-e8dc-4117-8c02-a6f9414faa23 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:56.595494 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87d697cf-e8dc-4117-8c02-a6f9414faa23 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:56.747805 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-87d697cf-e8dc-4117-8c02-a6f9414faa23 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:56.755286 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-87d697cf-e8dc-4117-8c02-a6f9414faa23 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.172745 Feb 10 03:38:56.755870 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 137/277] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:56 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:56.775907 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4cc4d8ac-8680-4065-a050-f06e200d7eca tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:56.776559 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4cc4d8ac-8680-4065-a050-f06e200d7eca tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:56.782940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4cc4d8ac-8680-4065-a050-f06e200d7eca tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:56.783382 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4cc4d8ac-8680-4065-a050-f06e200d7eca tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:56.784159 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4cc4d8ac-8680-4065-a050-f06e200d7eca tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:56.784580 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4cc4d8ac-8680-4065-a050-f06e200d7eca tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:56.926355 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4cc4d8ac-8680-4065-a050-f06e200d7eca tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:56.934640 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4cc4d8ac-8680-4065-a050-f06e200d7eca tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1507 microversion: 2.1 time: 0.162833 Feb 10 03:38:56.935257 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 141/278] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:56 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:57.109740 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b674207d-c816-4936-96ee-dadea5b802f6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:57.110470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b674207d-c816-4936-96ee-dadea5b802f6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:57.117483 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b674207d-c816-4936-96ee-dadea5b802f6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:57.118074 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b674207d-c816-4936-96ee-dadea5b802f6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:57.119044 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b674207d-c816-4936-96ee-dadea5b802f6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:57.119802 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b674207d-c816-4936-96ee-dadea5b802f6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:57.334251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b674207d-c816-4936-96ee-dadea5b802f6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:57.342289 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b674207d-c816-4936-96ee-dadea5b802f6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.239047 Feb 10 03:38:57.344101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 138/279] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:57 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:57.775897 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-77cc234a-8b46-41bc-ba4d-0b9b24ac1c12 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:57.777907 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-77cc234a-8b46-41bc-ba4d-0b9b24ac1c12 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:57.790630 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-77cc234a-8b46-41bc-ba4d-0b9b24ac1c12 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:57.791234 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-77cc234a-8b46-41bc-ba4d-0b9b24ac1c12 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:57.791875 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-77cc234a-8b46-41bc-ba4d-0b9b24ac1c12 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:57.792444 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-77cc234a-8b46-41bc-ba4d-0b9b24ac1c12 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:57.990131 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-77cc234a-8b46-41bc-ba4d-0b9b24ac1c12 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:58.000409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-77cc234a-8b46-41bc-ba4d-0b9b24ac1c12 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.229468 Feb 10 03:38:58.000409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 142/280] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:57 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:58.341442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0a4ab6a4-1d7c-478c-bb02-e58dea325985 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40059a4a-2b91-473e-9ad9-7d7970c4157f"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:58.342592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0a4ab6a4-1d7c-478c-bb02-e58dea325985 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:58.348779 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0a4ab6a4-1d7c-478c-bb02-e58dea325985 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:58.349216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0a4ab6a4-1d7c-478c-bb02-e58dea325985 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:58.349986 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0a4ab6a4-1d7c-478c-bb02-e58dea325985 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:58.350402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0a4ab6a4-1d7c-478c-bb02-e58dea325985 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:58.358731 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1cddfa3c-6b1b-4bbe-9077-129873845557 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:58.359331 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1cddfa3c-6b1b-4bbe-9077-129873845557 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:58.365982 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1cddfa3c-6b1b-4bbe-9077-129873845557 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:58.366471 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1cddfa3c-6b1b-4bbe-9077-129873845557 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:58.367642 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1cddfa3c-6b1b-4bbe-9077-129873845557 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:58.368099 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1cddfa3c-6b1b-4bbe-9077-129873845557 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:58.523785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1cddfa3c-6b1b-4bbe-9077-129873845557 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:58.531652 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1cddfa3c-6b1b-4bbe-9077-129873845557 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.176374 Feb 10 03:38:58.532527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 143/281] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:58 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:58.675060 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0a4ab6a4-1d7c-478c-bb02-e58dea325985 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337374 Feb 10 03:38:58.678711 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 139/282] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:38:58 2022] POST /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:59.019125 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-74af3fd2-1d4f-4513-b0eb-097204d22dfc tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:59.019733 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-74af3fd2-1d4f-4513-b0eb-097204d22dfc tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:59.026929 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-74af3fd2-1d4f-4513-b0eb-097204d22dfc tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:59.027370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-74af3fd2-1d4f-4513-b0eb-097204d22dfc tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:59.028139 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-74af3fd2-1d4f-4513-b0eb-097204d22dfc tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:59.028563 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-74af3fd2-1d4f-4513-b0eb-097204d22dfc tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:59.168987 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-74af3fd2-1d4f-4513-b0eb-097204d22dfc tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:59.176476 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-74af3fd2-1d4f-4513-b0eb-097204d22dfc tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.163309 Feb 10 03:38:59.177045 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 144/283] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:59 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:38:59.548046 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-1252cf95-7305-47b9-b82b-9e397e0d388c req-44bc350a-3ac4-4796-b9b6-17fb1d9196ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b92fc0-cfd3-4eb0-a15e-5d0558d253a9", "name": "network-vif-plugged", "status": "completed", "tag": "fafc4667-568b-4a5e-9472-26cc6a82e44a"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:38:59.549377 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-aab11d4e-3f87-4ceb-8824-a2451b0f70b7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:38:59.550058 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-aab11d4e-3f87-4ceb-8824-a2451b0f70b7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:38:59.551277 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:38:59.551277 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:38:59.558327 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aab11d4e-3f87-4ceb-8824-a2451b0f70b7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:59.558815 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aab11d4e-3f87-4ceb-8824-a2451b0f70b7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:59.559016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-1252cf95-7305-47b9-b82b-9e397e0d388c req-44bc350a-3ac4-4796-b9b6-17fb1d9196ae service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:59.559601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aab11d4e-3f87-4ceb-8824-a2451b0f70b7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:38:59.559807 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-1252cf95-7305-47b9-b82b-9e397e0d388c req-44bc350a-3ac4-4796-b9b6-17fb1d9196ae service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:59.560329 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aab11d4e-3f87-4ceb-8824-a2451b0f70b7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:38:59.573716 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-1252cf95-7305-47b9-b82b-9e397e0d388c req-44bc350a-3ac4-4796-b9b6-17fb1d9196ae service nova] Creating event network-vif-plugged:fafc4667-568b-4a5e-9472-26cc6a82e44a for instance 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 on hv-cinder-82806 Feb 10 03:38:59.579170 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-1252cf95-7305-47b9-b82b-9e397e0d388c req-44bc350a-3ac4-4796-b9b6-17fb1d9196ae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035773 Feb 10 03:38:59.579369 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 140/284] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:38:59.746569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-aab11d4e-3f87-4ceb-8824-a2451b0f70b7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:38:59.755323 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-aab11d4e-3f87-4ceb-8824-a2451b0f70b7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.209792 Feb 10 03:38:59.767179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 145/285] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:38:59 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:00.196930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0de8a72a-5430-487a-8359-43dbdbbec6b5 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:00.197546 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0de8a72a-5430-487a-8359-43dbdbbec6b5 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:00.204034 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0de8a72a-5430-487a-8359-43dbdbbec6b5 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:00.204616 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0de8a72a-5430-487a-8359-43dbdbbec6b5 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:00.205295 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0de8a72a-5430-487a-8359-43dbdbbec6b5 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:00.205728 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0de8a72a-5430-487a-8359-43dbdbbec6b5 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:00.361438 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0de8a72a-5430-487a-8359-43dbdbbec6b5 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:00.369862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0de8a72a-5430-487a-8359-43dbdbbec6b5 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.178993 Feb 10 03:39:00.370463 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 141/286] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:00 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:00.773527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e14419c7-d5a3-4c65-aefb-f0adb9c9e171 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:00.774095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e14419c7-d5a3-4c65-aefb-f0adb9c9e171 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:00.781512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e14419c7-d5a3-4c65-aefb-f0adb9c9e171 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:00.781955 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e14419c7-d5a3-4c65-aefb-f0adb9c9e171 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:00.782806 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e14419c7-d5a3-4c65-aefb-f0adb9c9e171 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:00.783317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e14419c7-d5a3-4c65-aefb-f0adb9c9e171 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:00.932309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e14419c7-d5a3-4c65-aefb-f0adb9c9e171 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:00.942017 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e14419c7-d5a3-4c65-aefb-f0adb9c9e171 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1320 microversion: 2.1 time: 0.172186 Feb 10 03:39:00.942624 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 146/287] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:00 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:01.387432 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fd7d25bf-5856-4ddb-887d-394b9a92c804 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:01.388063 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fd7d25bf-5856-4ddb-887d-394b9a92c804 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:01.394953 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fd7d25bf-5856-4ddb-887d-394b9a92c804 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:01.395407 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fd7d25bf-5856-4ddb-887d-394b9a92c804 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:01.396204 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fd7d25bf-5856-4ddb-887d-394b9a92c804 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:01.396641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fd7d25bf-5856-4ddb-887d-394b9a92c804 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:01.549481 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fd7d25bf-5856-4ddb-887d-394b9a92c804 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:01.559136 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fd7d25bf-5856-4ddb-887d-394b9a92c804 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.175396 Feb 10 03:39:01.559925 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 142/288] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:01 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:01.605257 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-d1221432-118f-4b1a-ac0d-6a5439ef2919 req-e21dac73-b9f3-4139-945b-679e8cb47bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea", "name": "network-vif-plugged", "status": "completed", "tag": "e19c2120-4b2b-405d-943c-f5030818eca4"}, {"server_uuid": "699b7ed3-80f5-47d0-bcec-6801073102d6", "name": "network-vif-plugged", "status": "completed", "tag": "1de8a500-64d0-4173-8581-65530f888f8a"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:01.608403 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:01.608403 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:39:01.618065 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-d1221432-118f-4b1a-ac0d-6a5439ef2919 req-e21dac73-b9f3-4139-945b-679e8cb47bb7 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:01.618604 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-d1221432-118f-4b1a-ac0d-6a5439ef2919 req-e21dac73-b9f3-4139-945b-679e8cb47bb7 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:01.633043 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-d1221432-118f-4b1a-ac0d-6a5439ef2919 req-e21dac73-b9f3-4139-945b-679e8cb47bb7 service nova] Creating event network-vif-plugged:e19c2120-4b2b-405d-943c-f5030818eca4 for instance 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea on hv-cinder-82806 Feb 10 03:39:01.633546 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-d1221432-118f-4b1a-ac0d-6a5439ef2919 req-e21dac73-b9f3-4139-945b-679e8cb47bb7 service nova] Creating event network-vif-plugged:1de8a500-64d0-4173-8581-65530f888f8a for instance 699b7ed3-80f5-47d0-bcec-6801073102d6 on hv-cinder-82806 Feb 10 03:39:01.640781 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-d1221432-118f-4b1a-ac0d-6a5439ef2919 req-e21dac73-b9f3-4139-945b-679e8cb47bb7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040507 Feb 10 03:39:01.641437 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 147/289] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:01.961368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7e02df06-ec0a-495d-aef2-7d7c728f33c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:01.962002 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7e02df06-ec0a-495d-aef2-7d7c728f33c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:01.968283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e02df06-ec0a-495d-aef2-7d7c728f33c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:01.968734 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e02df06-ec0a-495d-aef2-7d7c728f33c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:01.969528 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e02df06-ec0a-495d-aef2-7d7c728f33c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:01.969984 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e02df06-ec0a-495d-aef2-7d7c728f33c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.129378 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7e02df06-ec0a-495d-aef2-7d7c728f33c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:02.137151 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7e02df06-ec0a-495d-aef2-7d7c728f33c7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1515 microversion: 2.1 time: 0.179513 Feb 10 03:39:02.137771 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 143/290] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:01 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:02.159179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a2c59b8e-3ff1-4592-8ac2-c328ed2c954d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:02.160536 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a2c59b8e-3ff1-4592-8ac2-c328ed2c954d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:02.167536 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a2c59b8e-3ff1-4592-8ac2-c328ed2c954d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:02.168101 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a2c59b8e-3ff1-4592-8ac2-c328ed2c954d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.168983 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a2c59b8e-3ff1-4592-8ac2-c328ed2c954d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:02.169539 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a2c59b8e-3ff1-4592-8ac2-c328ed2c954d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.194466 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-a2c59b8e-3ff1-4592-8ac2-c328ed2c954d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lazy-loading 'flavor' on Instance uuid 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:39:02.312913 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a2c59b8e-3ff1-4592-8ac2-c328ed2c954d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9/action" status: 200 len: 32 microversion: 2.1 time: 0.160618 Feb 10 03:39:02.313412 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 148/291] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:39:02 2022] POST /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:39:02.325278 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b46332d9-3f61-4a0f-9795-15b6182695ef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:02.326185 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b46332d9-3f61-4a0f-9795-15b6182695ef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:02.337398 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b46332d9-3f61-4a0f-9795-15b6182695ef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:02.338042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b46332d9-3f61-4a0f-9795-15b6182695ef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.340405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b46332d9-3f61-4a0f-9795-15b6182695ef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:02.341243 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b46332d9-3f61-4a0f-9795-15b6182695ef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.491261 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b46332d9-3f61-4a0f-9795-15b6182695ef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:02.499290 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b46332d9-3f61-4a0f-9795-15b6182695ef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.178678 Feb 10 03:39:02.499919 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 144/292] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:02 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:02.576586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8ba67db8-5642-4d97-b9a1-aaef82394e9b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:02.577272 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8ba67db8-5642-4d97-b9a1-aaef82394e9b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:02.583703 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8ba67db8-5642-4d97-b9a1-aaef82394e9b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:02.584365 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8ba67db8-5642-4d97-b9a1-aaef82394e9b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.585374 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8ba67db8-5642-4d97-b9a1-aaef82394e9b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:02.585779 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8ba67db8-5642-4d97-b9a1-aaef82394e9b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.735610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8ba67db8-5642-4d97-b9a1-aaef82394e9b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:02.747190 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8ba67db8-5642-4d97-b9a1-aaef82394e9b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.174771 Feb 10 03:39:02.747762 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 149/293] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:02 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:02.824676 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-09a97887-1bc9-4ebe-ba40-4bb6db7a28f9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:02.825496 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-09a97887-1bc9-4ebe-ba40-4bb6db7a28f9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:02.834294 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09a97887-1bc9-4ebe-ba40-4bb6db7a28f9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:02.834774 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09a97887-1bc9-4ebe-ba40-4bb6db7a28f9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.836021 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09a97887-1bc9-4ebe-ba40-4bb6db7a28f9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:02.836669 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09a97887-1bc9-4ebe-ba40-4bb6db7a28f9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:02.861471 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-09a97887-1bc9-4ebe-ba40-4bb6db7a28f9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lazy-loading 'flavor' on Instance uuid d302b3d4-6282-4fbe-a4c4-248881ee8f51 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:39:03.161595 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-09a97887-1bc9-4ebe-ba40-4bb6db7a28f9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/action" status: 202 len: 0 microversion: 2.20 time: 0.342376 Feb 10 03:39:03.162221 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 145/294] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Feb 10 03:39:02 2022] POST /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:39:03.170423 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:03.171218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:03.178016 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:03.178784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:03.179567 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:03.179979 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:03.321857 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:03.329949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:03.331489 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:03.332635 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-137a040e-ef88-4b7f-a8d6-d899c004b35a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.166057 Feb 10 03:39:03.333195 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 150/295] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:03 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:03.517634 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e95a4aad-120b-42ee-b9c5-dcc6ab0dec5b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:03.518336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e95a4aad-120b-42ee-b9c5-dcc6ab0dec5b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:03.526413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e95a4aad-120b-42ee-b9c5-dcc6ab0dec5b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:03.527038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e95a4aad-120b-42ee-b9c5-dcc6ab0dec5b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:03.527902 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e95a4aad-120b-42ee-b9c5-dcc6ab0dec5b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:03.528340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e95a4aad-120b-42ee-b9c5-dcc6ab0dec5b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:03.687235 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e95a4aad-120b-42ee-b9c5-dcc6ab0dec5b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:03.695541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e95a4aad-120b-42ee-b9c5-dcc6ab0dec5b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.182440 Feb 10 03:39:03.696192 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 146/296] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:03 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:03.766394 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b56a03b1-e47b-4123-9c68-2d4a131e7662 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:03.769944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b56a03b1-e47b-4123-9c68-2d4a131e7662 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:03.776386 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b56a03b1-e47b-4123-9c68-2d4a131e7662 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:03.777218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b56a03b1-e47b-4123-9c68-2d4a131e7662 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:03.778533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b56a03b1-e47b-4123-9c68-2d4a131e7662 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:03.779030 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b56a03b1-e47b-4123-9c68-2d4a131e7662 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:03.931695 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b56a03b1-e47b-4123-9c68-2d4a131e7662 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:03.939142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b56a03b1-e47b-4123-9c68-2d4a131e7662 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1313 microversion: 2.1 time: 0.178119 Feb 10 03:39:03.939726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 151/297] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:03 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:04.354606 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:04.355230 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:04.362274 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:04.363287 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:04.364212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:04.364644 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:04.519661 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:04.527981 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:04.529515 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:04.530671 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6f8605ab-bbcb-4033-9ac2-4c3db92c29eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.181675 Feb 10 03:39:04.531233 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 147/298] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:04 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:04.714399 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-618a57d4-8a20-49db-977a-be4bbb10ed77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:04.715318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-618a57d4-8a20-49db-977a-be4bbb10ed77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:04.724968 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-618a57d4-8a20-49db-977a-be4bbb10ed77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:04.725607 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-618a57d4-8a20-49db-977a-be4bbb10ed77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:04.726413 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-618a57d4-8a20-49db-977a-be4bbb10ed77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:04.727002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-618a57d4-8a20-49db-977a-be4bbb10ed77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:04.871958 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-618a57d4-8a20-49db-977a-be4bbb10ed77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:04.879820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-618a57d4-8a20-49db-977a-be4bbb10ed77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.169588 Feb 10 03:39:04.880587 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 152/299] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:04 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:04.955423 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0fbed436-dce5-4930-afdf-bf3fbc6e5525 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:04.956030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0fbed436-dce5-4930-afdf-bf3fbc6e5525 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:04.961902 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0fbed436-dce5-4930-afdf-bf3fbc6e5525 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:04.962374 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0fbed436-dce5-4930-afdf-bf3fbc6e5525 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:04.963169 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0fbed436-dce5-4930-afdf-bf3fbc6e5525 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:04.963601 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0fbed436-dce5-4930-afdf-bf3fbc6e5525 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:05.110489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0fbed436-dce5-4930-afdf-bf3fbc6e5525 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:05.132671 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0fbed436-dce5-4930-afdf-bf3fbc6e5525 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1497 microversion: 2.1 time: 0.180832 Feb 10 03:39:05.133316 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 148/300] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:04 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:05.548725 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:05.549270 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:05.555537 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:05.555959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:05.556759 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:05.557154 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:05.714483 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:05.723130 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:05.724638 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:05.725780 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c0d4a971-7f50-4176-b8ac-400700c36e53 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.180897 Feb 10 03:39:05.726332 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 153/301] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:05 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:05.897222 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6068b496-fc90-4ffa-9f8f-83dc6fc1b987 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:05.897816 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6068b496-fc90-4ffa-9f8f-83dc6fc1b987 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:05.904449 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6068b496-fc90-4ffa-9f8f-83dc6fc1b987 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:05.904943 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6068b496-fc90-4ffa-9f8f-83dc6fc1b987 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:05.905756 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6068b496-fc90-4ffa-9f8f-83dc6fc1b987 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:05.906203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6068b496-fc90-4ffa-9f8f-83dc6fc1b987 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:06.051333 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6068b496-fc90-4ffa-9f8f-83dc6fc1b987 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:06.059033 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6068b496-fc90-4ffa-9f8f-83dc6fc1b987 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.165859 Feb 10 03:39:06.059715 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 149/302] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:05 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:06.328662 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5dfef209-a4d5-4f90-b6d1-06dacc498b4f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:06.329535 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5dfef209-a4d5-4f90-b6d1-06dacc498b4f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:06.337949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5dfef209-a4d5-4f90-b6d1-06dacc498b4f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:06.338966 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5dfef209-a4d5-4f90-b6d1-06dacc498b4f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:06.340347 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5dfef209-a4d5-4f90-b6d1-06dacc498b4f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:06.340935 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5dfef209-a4d5-4f90-b6d1-06dacc498b4f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:06.368036 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5dfef209-a4d5-4f90-b6d1-06dacc498b4f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:39:06.453946 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5dfef209-a4d5-4f90-b6d1-06dacc498b4f tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "DELETE /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 204 len: 0 microversion: 2.1 time: 0.128638 Feb 10 03:39:06.455093 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 154/303] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:39:06 2022] DELETE /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:39:06.465803 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7b6236eb-2571-48b9-a85b-bcf2aa6a0e60 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:06.466532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7b6236eb-2571-48b9-a85b-bcf2aa6a0e60 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:06.482595 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7b6236eb-2571-48b9-a85b-bcf2aa6a0e60 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:06.483268 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7b6236eb-2571-48b9-a85b-bcf2aa6a0e60 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:06.484105 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7b6236eb-2571-48b9-a85b-bcf2aa6a0e60 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:06.484691 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7b6236eb-2571-48b9-a85b-bcf2aa6a0e60 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:06.629560 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7b6236eb-2571-48b9-a85b-bcf2aa6a0e60 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:06.637432 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7b6236eb-2571-48b9-a85b-bcf2aa6a0e60 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1503 microversion: 2.1 time: 0.177126 Feb 10 03:39:06.638044 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 150/304] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:06 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:06.745178 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:06.745863 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:06.753022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:06.753466 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:06.754240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:06.754677 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:06.893340 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:06.902110 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:06.903632 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:06.904764 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-81c3b30a-1e83-415c-918a-473090e6dbb3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.163818 Feb 10 03:39:06.905318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 155/305] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:06 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:07.076208 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ca7c1766-10fc-44cd-9516-07dc83390687 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:07.076770 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ca7c1766-10fc-44cd-9516-07dc83390687 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:07.083592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ca7c1766-10fc-44cd-9516-07dc83390687 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.084037 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ca7c1766-10fc-44cd-9516-07dc83390687 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.084820 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ca7c1766-10fc-44cd-9516-07dc83390687 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.085257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ca7c1766-10fc-44cd-9516-07dc83390687 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.226857 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ca7c1766-10fc-44cd-9516-07dc83390687 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:07.234522 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ca7c1766-10fc-44cd-9516-07dc83390687 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.162140 Feb 10 03:39:07.235119 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 151/306] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:07 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:07.266832 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40059a4a-2b91-473e-9ad9-7d7970c4157f"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:07.268092 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:07.274570 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.275142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.276156 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.276658 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.356627 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] HTTP exception thrown: Invalid volume: volume 40059a4a-2b91-473e-9ad9-7d7970c4157f is already attached to instances: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 Feb 10 03:39:07.357245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Returning 400 to user: Invalid volume: volume 40059a4a-2b91-473e-9ad9-7d7970c4157f is already attached to instances: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:39:07.358077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c7a67973-73ab-40c3-9297-f2275a10891c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095390 Feb 10 03:39:07.358676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 156/307] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:39:07 2022] POST /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:39:07.424804 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-71cd23fd-55ce-4ef8-9a9e-90dd1efbcc2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:07.425293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-71cd23fd-55ce-4ef8-9a9e-90dd1efbcc2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:07.433376 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-71cd23fd-55ce-4ef8-9a9e-90dd1efbcc2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.433826 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-71cd23fd-55ce-4ef8-9a9e-90dd1efbcc2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.434609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-71cd23fd-55ce-4ef8-9a9e-90dd1efbcc2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.435073 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-71cd23fd-55ce-4ef8-9a9e-90dd1efbcc2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.521052 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-71cd23fd-55ce-4ef8-9a9e-90dd1efbcc2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lazy-loading 'services' on Instance uuid 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:39:07.604754 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-71cd23fd-55ce-4ef8-9a9e-90dd1efbcc2f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments/40059a4a-2b91-473e-9ad9-7d7970c4157f" status: 202 len: 0 microversion: 2.1 time: 0.183608 Feb 10 03:39:07.605954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 152/308] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:39:07 2022] DELETE /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments/40059a4a-2b91-473e-9ad9-7d7970c4157f => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:39:07.614497 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-068b80cc-3171-4dcd-ae2e-99cd5d207c92 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:07.615438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-068b80cc-3171-4dcd-ae2e-99cd5d207c92 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:07.623523 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-068b80cc-3171-4dcd-ae2e-99cd5d207c92 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.624026 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-068b80cc-3171-4dcd-ae2e-99cd5d207c92 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.624837 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-068b80cc-3171-4dcd-ae2e-99cd5d207c92 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.625251 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-068b80cc-3171-4dcd-ae2e-99cd5d207c92 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.655522 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dd8e435b-3ff1-45d9-b98f-0a66a20811bf tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:07.656149 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dd8e435b-3ff1-45d9-b98f-0a66a20811bf tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:07.657741 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-068b80cc-3171-4dcd-ae2e-99cd5d207c92 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Feb 10 03:39:07.658602 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 157/309] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:39:07 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:07.667389 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd8e435b-3ff1-45d9-b98f-0a66a20811bf tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.667929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd8e435b-3ff1-45d9-b98f-0a66a20811bf tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.668792 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd8e435b-3ff1-45d9-b98f-0a66a20811bf tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.669310 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd8e435b-3ff1-45d9-b98f-0a66a20811bf tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.813014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dd8e435b-3ff1-45d9-b98f-0a66a20811bf tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:07.820574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dd8e435b-3ff1-45d9-b98f-0a66a20811bf tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1503 microversion: 2.1 time: 0.169430 Feb 10 03:39:07.821251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 153/310] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:07 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:07.923608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:07.924206 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:07.930915 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.931371 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:07.932600 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:07.932600 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:08.168678 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:08.179747 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:08.181451 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:08.182621 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7efc8174-45ab-4513-9319-8ba8741ebfc6 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.262864 Feb 10 03:39:08.183520 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 158/311] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:07 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:08.252086 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-848b49f7-09e4-4d64-8f49-1040436d88aa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:08.252724 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-848b49f7-09e4-4d64-8f49-1040436d88aa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:08.259642 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-848b49f7-09e4-4d64-8f49-1040436d88aa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:08.260095 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-848b49f7-09e4-4d64-8f49-1040436d88aa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:08.261092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-848b49f7-09e4-4d64-8f49-1040436d88aa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:08.261525 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-848b49f7-09e4-4d64-8f49-1040436d88aa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:08.410564 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-848b49f7-09e4-4d64-8f49-1040436d88aa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:08.418940 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-848b49f7-09e4-4d64-8f49-1040436d88aa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.170500 Feb 10 03:39:08.428351 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 154/312] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:08 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:08.670869 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c80880c3-8bef-4b40-acef-f3ca3b6012f8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:08.671767 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c80880c3-8bef-4b40-acef-f3ca3b6012f8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:08.678729 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c80880c3-8bef-4b40-acef-f3ca3b6012f8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:08.679253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c80880c3-8bef-4b40-acef-f3ca3b6012f8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:08.680261 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c80880c3-8bef-4b40-acef-f3ca3b6012f8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:08.680719 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c80880c3-8bef-4b40-acef-f3ca3b6012f8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:08.727277 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c80880c3-8bef-4b40-acef-f3ca3b6012f8 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061394 Feb 10 03:39:08.727832 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 159/313] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:39:08 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:08.837640 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-5b206b3c-99c1-4354-9b98-d245870f79e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:08.839134 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-5b206b3c-99c1-4354-9b98-d245870f79e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:08.844831 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5b206b3c-99c1-4354-9b98-d245870f79e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:08.845281 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5b206b3c-99c1-4354-9b98-d245870f79e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:08.846097 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5b206b3c-99c1-4354-9b98-d245870f79e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:08.846582 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5b206b3c-99c1-4354-9b98-d245870f79e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:09.153260 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-5b206b3c-99c1-4354-9b98-d245870f79e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:09.163267 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-5b206b3c-99c1-4354-9b98-d245870f79e4 tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1503 microversion: 2.1 time: 0.329539 Feb 10 03:39:09.166379 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 155/314] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:08 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:09.201492 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:09.202091 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:09.208576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:09.209451 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:09.210300 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:09.210841 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:09.380480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:09.388707 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:09.390594 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:09.392042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5b7c12c8-60ab-49c3-bc2c-60e7d7f805b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.194428 Feb 10 03:39:09.392833 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 160/315] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:09 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:09.436038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-863b5306-0109-4d5c-b66b-2dc723a2b4a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:09.436673 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-863b5306-0109-4d5c-b66b-2dc723a2b4a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:09.443197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-863b5306-0109-4d5c-b66b-2dc723a2b4a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:09.443878 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-863b5306-0109-4d5c-b66b-2dc723a2b4a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:09.444840 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-863b5306-0109-4d5c-b66b-2dc723a2b4a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:09.445275 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-863b5306-0109-4d5c-b66b-2dc723a2b4a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:09.645886 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-863b5306-0109-4d5c-b66b-2dc723a2b4a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:09.654898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-863b5306-0109-4d5c-b66b-2dc723a2b4a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.222345 Feb 10 03:39:09.655626 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 156/316] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:09 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:09.740121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dd8c36ef-8f0b-4742-8643-ba15432b8638 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:09.741047 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dd8c36ef-8f0b-4742-8643-ba15432b8638 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:09.747991 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd8c36ef-8f0b-4742-8643-ba15432b8638 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:09.748662 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd8c36ef-8f0b-4742-8643-ba15432b8638 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:09.749651 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd8c36ef-8f0b-4742-8643-ba15432b8638 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:09.750245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dd8c36ef-8f0b-4742-8643-ba15432b8638 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:09.781433 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dd8c36ef-8f0b-4742-8643-ba15432b8638 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045530 Feb 10 03:39:09.782014 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 161/317] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:39:09 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:39:09.808257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-69bdad01-b689-4acd-84a4-3d69b7eae38c req-5c738d64-2e07-4e5c-8140-eaa8e6c705aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea", "name": "network-vif-deleted", "tag": "e19c2120-4b2b-405d-943c-f5030818eca4"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:09.809983 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:09.809983 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:39:09.819008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-69bdad01-b689-4acd-84a4-3d69b7eae38c req-5c738d64-2e07-4e5c-8140-eaa8e6c705aa service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:09.819798 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-69bdad01-b689-4acd-84a4-3d69b7eae38c req-5c738d64-2e07-4e5c-8140-eaa8e6c705aa service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:09.832219 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-69bdad01-b689-4acd-84a4-3d69b7eae38c req-5c738d64-2e07-4e5c-8140-eaa8e6c705aa service nova] Creating event network-vif-deleted:e19c2120-4b2b-405d-943c-f5030818eca4 for instance 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea on hv-cinder-82806 Feb 10 03:39:09.857750 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-69bdad01-b689-4acd-84a4-3d69b7eae38c req-5c738d64-2e07-4e5c-8140-eaa8e6c705aa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033538 Feb 10 03:39:09.859125 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 157/318] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:09.970282 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-406560915", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "4fceb00b-34fd-4a2b-b18c-a9d9c74a66d0"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:10.025545 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] validate_networks() for [('4fceb00b-34fd-4a2b-b18c-a9d9c74a66d0', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:39:10.185170 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:10.186118 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:10.193502 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.194275 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.196001 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.196152 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.247809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.251054 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.251520 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lazy-loading 'fault' on Instance uuid 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:39:10.325549 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c4ac1332b64a648d7214918f757f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f20a9d15eb4d99bf667578a36a9f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:10.338343 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7e68546e-d72e-483e-aa3a-6ef26bb7ff5c tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 200 len: 1303 microversion: 2.1 time: 0.157836 Feb 10 03:39:10.338794 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 158/319] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:10 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:10.412227 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:10.412846 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:10.422518 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.422995 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.423988 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.424618 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.458952 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:39:10.459975 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:39:10.460610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:39:10.461160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:39:10.461726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:39:10.472150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.472824 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.473789 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.474410 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.493700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Getting quotas for project d7bf7bed71094487b57906e39d043543. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:39:10.498131 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Getting quotas for user 5adf0f1d005d4a1eb0136d4593b094b5 and project d7bf7bed71094487b57906e39d043543. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:39:10.516200 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:39:10.522010 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:39:10.584505 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c038e5d0-0150-4ce2-af7a-aa6c81e8fdbb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617806 Feb 10 03:39:10.585742 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 162/320] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:39:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:39:10.593177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:10.601202 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5e7eb9ff-55b8-42e2-934a-ef39cf3a30a4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:10.601802 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5e7eb9ff-55b8-42e2-934a-ef39cf3a30a4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:10.609612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:10.611174 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:10.612393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-38db5f05-6a79-4470-af9e-79dddcf5ba41 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.205467 Feb 10 03:39:10.612922 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 159/321] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:10 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:10.676680 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1a3853d4-23ae-40e1-a5c6-9e59863e64e7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:10.676680 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1a3853d4-23ae-40e1-a5c6-9e59863e64e7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:10.686575 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1a3853d4-23ae-40e1-a5c6-9e59863e64e7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.686575 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1a3853d4-23ae-40e1-a5c6-9e59863e64e7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.686575 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1a3853d4-23ae-40e1-a5c6-9e59863e64e7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:10.686575 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1a3853d4-23ae-40e1-a5c6-9e59863e64e7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:10.687053 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5e7eb9ff-55b8-42e2-934a-ef39cf3a30a4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:10.697858 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5e7eb9ff-55b8-42e2-934a-ef39cf3a30a4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1217 microversion: 2.1 time: 0.100234 Feb 10 03:39:10.699985 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 163/322] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:10 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:10.849862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1a3853d4-23ae-40e1-a5c6-9e59863e64e7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:10.861393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1a3853d4-23ae-40e1-a5c6-9e59863e64e7 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.191937 Feb 10 03:39:10.861393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 160/323] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:10 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:11.354877 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:11.355527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] [instance: 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:11.363012 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:11.363571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:11.364428 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:11.364940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:11.380995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] HTTP exception thrown: Instance 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea could not be found. Feb 10 03:39:11.381809 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] Returning 404 to user: Instance 99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:39:11.382989 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-52d073c7-c42f-4581-b969-51bb72cc533b tempest-VolumesActionsTest-354431124 tempest-VolumesActionsTest-354431124-project] 10.222.0.32 "GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea" status: 404 len: 111 microversion: 2.1 time: 0.031987 Feb 10 03:39:11.386839 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 164/324] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:11 2022] GET /compute/v2.1/servers/99a9e0e8-acbb-4d1c-8c71-e9bdafd40dea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:39:11.632292 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:11.634780 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:11.641354 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:11.641800 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:11.642587 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:11.643055 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:11.716618 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-431f23f0-60e6-4c00-b6f6-b760ad939f8c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:11.717895 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-431f23f0-60e6-4c00-b6f6-b760ad939f8c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:11.745022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-431f23f0-60e6-4c00-b6f6-b760ad939f8c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:11.745461 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-431f23f0-60e6-4c00-b6f6-b760ad939f8c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:11.746613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-431f23f0-60e6-4c00-b6f6-b760ad939f8c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:11.747503 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-431f23f0-60e6-4c00-b6f6-b760ad939f8c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:11.851881 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-431f23f0-60e6-4c00-b6f6-b760ad939f8c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:11.859799 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-431f23f0-60e6-4c00-b6f6-b760ad939f8c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1277 microversion: 2.1 time: 0.147532 Feb 10 03:39:11.881488 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 165/325] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:11 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:11.887205 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4bbd2889-8517-4e6d-984a-ad7fee1e16ca tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:11.888437 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4bbd2889-8517-4e6d-984a-ad7fee1e16ca tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:11.901422 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bbd2889-8517-4e6d-984a-ad7fee1e16ca tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:11.902248 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bbd2889-8517-4e6d-984a-ad7fee1e16ca tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:11.903351 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bbd2889-8517-4e6d-984a-ad7fee1e16ca tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:11.904615 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bbd2889-8517-4e6d-984a-ad7fee1e16ca tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:11.928195 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:11.948450 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:11.950010 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:11.952752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-668894f8-c4c5-40b4-8cfc-b0ca61f7b7b4 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.324357 Feb 10 03:39:11.953339 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 161/326] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:11 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:12.134861 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4bbd2889-8517-4e6d-984a-ad7fee1e16ca tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:12.143271 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4bbd2889-8517-4e6d-984a-ad7fee1e16ca tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.260581 Feb 10 03:39:12.145015 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 166/327] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:11 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:12.883179 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e6fd209c-177e-444a-bb05-a1f329d6f180 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:12.883766 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e6fd209c-177e-444a-bb05-a1f329d6f180 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:12.890111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6fd209c-177e-444a-bb05-a1f329d6f180 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:12.890562 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6fd209c-177e-444a-bb05-a1f329d6f180 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:12.891372 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6fd209c-177e-444a-bb05-a1f329d6f180 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:12.891833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6fd209c-177e-444a-bb05-a1f329d6f180 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:12.971324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:12.971972 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:12.981837 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:12.982364 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:12.983283 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:12.983886 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:13.037938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e6fd209c-177e-444a-bb05-a1f329d6f180 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:13.047110 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e6fd209c-177e-444a-bb05-a1f329d6f180 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.167147 Feb 10 03:39:13.048128 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 162/328] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:12 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:13.129476 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:13.137850 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:13.139388 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:13.140585 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2d08b4d0-be5e-4a73-b42c-4346657c3748 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.173070 Feb 10 03:39:13.141178 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 167/329] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:12 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:13.161234 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-08fd2bb9-dbec-4a28-8117-6fd6946e30fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:13.161840 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-08fd2bb9-dbec-4a28-8117-6fd6946e30fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:13.167726 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-08fd2bb9-dbec-4a28-8117-6fd6946e30fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:13.168344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-08fd2bb9-dbec-4a28-8117-6fd6946e30fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:13.169121 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-08fd2bb9-dbec-4a28-8117-6fd6946e30fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:13.169557 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-08fd2bb9-dbec-4a28-8117-6fd6946e30fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:13.303879 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-08fd2bb9-dbec-4a28-8117-6fd6946e30fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:13.313820 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-08fd2bb9-dbec-4a28-8117-6fd6946e30fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.156152 Feb 10 03:39:13.323799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 163/330] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:13 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:14.065021 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4d37b94c-8149-47cb-a98e-804c8cb931bb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:14.065604 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4d37b94c-8149-47cb-a98e-804c8cb931bb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:14.072786 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4d37b94c-8149-47cb-a98e-804c8cb931bb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:14.073237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4d37b94c-8149-47cb-a98e-804c8cb931bb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:14.074038 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4d37b94c-8149-47cb-a98e-804c8cb931bb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:14.074474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4d37b94c-8149-47cb-a98e-804c8cb931bb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:14.159206 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:14.159958 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:14.166599 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:14.167093 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:14.167875 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:14.168318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:14.240548 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4d37b94c-8149-47cb-a98e-804c8cb931bb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:14.248490 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4d37b94c-8149-47cb-a98e-804c8cb931bb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.187245 Feb 10 03:39:14.249052 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 168/331] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:14 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:14.320402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:14.329051 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:14.330511 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ec29d606-ae53-46a2-9329-ca6b923c57ae tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:14.330632 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:14.331142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ec29d606-ae53-46a2-9329-ca6b923c57ae tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:14.331802 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d17b1166-3c5a-48bb-a2ac-8fd1a90c1387 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.176534 Feb 10 03:39:14.332387 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 164/332] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:14 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:14.337403 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ec29d606-ae53-46a2-9329-ca6b923c57ae tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:14.337851 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ec29d606-ae53-46a2-9329-ca6b923c57ae tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:14.338638 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ec29d606-ae53-46a2-9329-ca6b923c57ae tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:14.339128 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ec29d606-ae53-46a2-9329-ca6b923c57ae tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:14.482681 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ec29d606-ae53-46a2-9329-ca6b923c57ae tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:14.490410 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ec29d606-ae53-46a2-9329-ca6b923c57ae tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.163517 Feb 10 03:39:14.490948 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 169/333] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:14 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:15.267333 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a6806b1b-4673-4266-b730-e751ca02ca9f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:15.267927 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a6806b1b-4673-4266-b730-e751ca02ca9f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:15.274699 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a6806b1b-4673-4266-b730-e751ca02ca9f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:15.275174 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a6806b1b-4673-4266-b730-e751ca02ca9f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:15.275956 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a6806b1b-4673-4266-b730-e751ca02ca9f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:15.276392 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a6806b1b-4673-4266-b730-e751ca02ca9f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:15.350964 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:15.352274 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:15.360715 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:15.361524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:15.362629 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:15.363254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:15.457664 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a6806b1b-4673-4266-b730-e751ca02ca9f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:15.469073 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a6806b1b-4673-4266-b730-e751ca02ca9f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.206480 Feb 10 03:39:15.469747 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 165/334] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:15 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:15.507558 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-8fa78447-1db1-435c-82a4-7b6360b4e63a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:15.508167 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8fa78447-1db1-435c-82a4-7b6360b4e63a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:15.514428 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8fa78447-1db1-435c-82a4-7b6360b4e63a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:15.514923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8fa78447-1db1-435c-82a4-7b6360b4e63a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:15.515713 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8fa78447-1db1-435c-82a4-7b6360b4e63a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:15.516187 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8fa78447-1db1-435c-82a4-7b6360b4e63a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:15.530011 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:15.540225 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:15.541742 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:15.542976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0e340b8b-81c3-4ece-95bd-08f3f1b55eba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.195657 Feb 10 03:39:15.543515 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 170/335] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:15 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:15.661345 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-8fa78447-1db1-435c-82a4-7b6360b4e63a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:15.668884 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-8fa78447-1db1-435c-82a4-7b6360b4e63a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.165013 Feb 10 03:39:15.669472 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 166/336] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:15 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:16.211100 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-405bfe08-4f75-4309-b5fc-a2f83bf2c069 req-7308ed41-72f7-4956-b024-2a726dae3c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b2d5f1-131a-4713-9d41-f99e7b3897c7", "tag": "b590bb01-bf48-4666-8123-155cb2cc0ab8"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:16.212739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:16.212739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:39:16.220247 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-405bfe08-4f75-4309-b5fc-a2f83bf2c069 req-7308ed41-72f7-4956-b024-2a726dae3c36 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:16.220784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-405bfe08-4f75-4309-b5fc-a2f83bf2c069 req-7308ed41-72f7-4956-b024-2a726dae3c36 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:16.232843 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-405bfe08-4f75-4309-b5fc-a2f83bf2c069 req-7308ed41-72f7-4956-b024-2a726dae3c36 service nova] Creating event network-changed:b590bb01-bf48-4666-8123-155cb2cc0ab8 for instance 49b2d5f1-131a-4713-9d41-f99e7b3897c7 on hv-cinder-82806 Feb 10 03:39:16.237862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-405bfe08-4f75-4309-b5fc-a2f83bf2c069 req-7308ed41-72f7-4956-b024-2a726dae3c36 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030351 Feb 10 03:39:16.238975 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 171/337] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:16.485247 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-cd73b410-968d-428d-aeae-f5e3426158ef tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:16.485857 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-cd73b410-968d-428d-aeae-f5e3426158ef tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:16.493117 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cd73b410-968d-428d-aeae-f5e3426158ef tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:16.493545 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cd73b410-968d-428d-aeae-f5e3426158ef tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:16.494776 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cd73b410-968d-428d-aeae-f5e3426158ef tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:16.495257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cd73b410-968d-428d-aeae-f5e3426158ef tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:16.563449 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:16.564324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:16.572674 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:16.573363 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:16.574228 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:16.574750 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:16.683042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cd73b410-968d-428d-aeae-f5e3426158ef tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:16.694809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-cd73b410-968d-428d-aeae-f5e3426158ef tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.213164 Feb 10 03:39:16.695583 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 167/338] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:16 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:16.700941 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4b286bbe-d48b-48e4-b720-e374037c1698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:16.701833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4b286bbe-d48b-48e4-b720-e374037c1698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:16.709007 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4b286bbe-d48b-48e4-b720-e374037c1698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:16.709691 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4b286bbe-d48b-48e4-b720-e374037c1698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:16.710572 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4b286bbe-d48b-48e4-b720-e374037c1698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:16.711213 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4b286bbe-d48b-48e4-b720-e374037c1698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:16.748142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:16.756092 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:16.757596 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:16.758817 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3a949380-d3ed-4fc6-86d7-1a3a66f5ca3b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.200188 Feb 10 03:39:16.759357 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 172/339] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:16 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:16.848223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4b286bbe-d48b-48e4-b720-e374037c1698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:16.855621 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4b286bbe-d48b-48e4-b720-e374037c1698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.159053 Feb 10 03:39:16.856198 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 168/340] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:16 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:17.523029 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a1855d2b-771a-40a5-9de1-e8313589f19c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f18dbd14-7923-4730-95f3-c943e27878ae"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:17.524121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a1855d2b-771a-40a5-9de1-e8313589f19c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:17.529957 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1855d2b-771a-40a5-9de1-e8313589f19c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:17.530395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1855d2b-771a-40a5-9de1-e8313589f19c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:17.531214 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1855d2b-771a-40a5-9de1-e8313589f19c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:17.531640 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1855d2b-771a-40a5-9de1-e8313589f19c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:17.712762 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dce95cfc-1185-4d86-93a3-35d4440a094b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:17.713375 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dce95cfc-1185-4d86-93a3-35d4440a094b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:17.719785 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dce95cfc-1185-4d86-93a3-35d4440a094b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:17.720283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dce95cfc-1185-4d86-93a3-35d4440a094b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:17.721004 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dce95cfc-1185-4d86-93a3-35d4440a094b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:17.721501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dce95cfc-1185-4d86-93a3-35d4440a094b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:17.836585 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a1855d2b-771a-40a5-9de1-e8313589f19c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317305 Feb 10 03:39:17.837764 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 173/341] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:39:17 2022] POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:17.843750 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:17.844657 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:17.851803 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:17.863633 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:17.865648 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:17.866308 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:17.894007 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dce95cfc-1185-4d86-93a3-35d4440a094b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:17.904178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dce95cfc-1185-4d86-93a3-35d4440a094b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.195588 Feb 10 03:39:17.905578 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 169/342] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:17 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:17.910915 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9fee79ac-1f52-4f41-9e1d-ac2c5be7f424 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:17.911939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9fee79ac-1f52-4f41-9e1d-ac2c5be7f424 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:17.920340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9fee79ac-1f52-4f41-9e1d-ac2c5be7f424 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:17.921101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9fee79ac-1f52-4f41-9e1d-ac2c5be7f424 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:17.922129 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9fee79ac-1f52-4f41-9e1d-ac2c5be7f424 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:17.922975 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9fee79ac-1f52-4f41-9e1d-ac2c5be7f424 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:18.208938 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:18.212187 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-9fee79ac-1f52-4f41-9e1d-ac2c5be7f424 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:18.218627 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:18.220322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:18.221692 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-26a2bf7b-e505-4add-b465-b5838996bb15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.382745 Feb 10 03:39:18.222401 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 174/343] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:17 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:18.222518 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9fee79ac-1f52-4f41-9e1d-ac2c5be7f424 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.315787 Feb 10 03:39:18.223164 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 170/344] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:17 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:18.324291 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1937042798", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1051863551", "security_groups": [{"name": "tempest-secgroup-smoke-497865012"}], "block_device_mapping_v2": [{"uuid": "264870f4-c316-442d-925a-5bfd33641903", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3af7982f-b432-4a57-9896-b601a1ffbd3e"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:18.445484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] validate_networks() for [('3af7982f-b432-4a57-9896-b601a1ffbd3e', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:39:18.921930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-72dac222-0990-452e-a61f-1ddd867a3bc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:18.923413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-72dac222-0990-452e-a61f-1ddd867a3bc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:18.930437 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72dac222-0990-452e-a61f-1ddd867a3bc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:18.931133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72dac222-0990-452e-a61f-1ddd867a3bc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:18.932100 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72dac222-0990-452e-a61f-1ddd867a3bc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:18.932850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72dac222-0990-452e-a61f-1ddd867a3bc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:19.232134 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-72dac222-0990-452e-a61f-1ddd867a3bc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:19.242587 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-72dac222-0990-452e-a61f-1ddd867a3bc6 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.324614 Feb 10 03:39:19.243234 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 171/345] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:18 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:19.252322 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:19.263616 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:19.270217 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:19.270693 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:19.271502 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:19.271942 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:19.379859 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:39:19.380431 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:39:19.380866 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:39:19.381328 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:39:19.381965 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:39:19.394148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:19.394596 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:19.395445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:19.395880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:19.442768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for project 9861d9e039084b9b9b24721464eea6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:39:19.447514 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for user 1521bf93314c437798ef374963def38e and project 9861d9e039084b9b9b24721464eea6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:39:19.474373 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:19.483191 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:19.485175 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:19.486426 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-09599187-9055-4dae-aa18-bbe1ce7aed70 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.242102 Feb 10 03:39:19.487314 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 172/346] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:19 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:19.491880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c9506273-205f-4905-bd14-7c030eb3cac4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:19.492711 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c9506273-205f-4905-bd14-7c030eb3cac4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:19.500029 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c9506273-205f-4905-bd14-7c030eb3cac4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:19.500727 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c9506273-205f-4905-bd14-7c030eb3cac4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:19.501944 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c9506273-205f-4905-bd14-7c030eb3cac4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:19.502710 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c9506273-205f-4905-bd14-7c030eb3cac4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:19.524913 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:39:19.527067 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='264870f4-c316-442d-925a-5bfd33641903',volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:39:19.667809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c9506273-205f-4905-bd14-7c030eb3cac4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:19.678947 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c9506273-205f-4905-bd14-7c030eb3cac4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.190341 Feb 10 03:39:19.683536 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 173/347] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:19 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:19.704285 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-12b37d2c-58ca-432b-8fc6-3b6c207523b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.384293 Feb 10 03:39:19.705240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 175/348] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:39:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:39:19.716495 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-17687e1b-e520-40c1-be10-d403b59bdfb2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:19.717686 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-17687e1b-e520-40c1-be10-d403b59bdfb2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:19.790612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-17687e1b-e520-40c1-be10-d403b59bdfb2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:19.799608 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-17687e1b-e520-40c1-be10-d403b59bdfb2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1095 microversion: 2.1 time: 0.087458 Feb 10 03:39:19.801471 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 174/349] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:19 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:20.261698 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5def21ec-238e-4622-aee6-100a3d95d888 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:20.262318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5def21ec-238e-4622-aee6-100a3d95d888 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:20.269625 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5def21ec-238e-4622-aee6-100a3d95d888 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:20.270077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5def21ec-238e-4622-aee6-100a3d95d888 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:20.270971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5def21ec-238e-4622-aee6-100a3d95d888 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:20.271438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5def21ec-238e-4622-aee6-100a3d95d888 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:20.478358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5def21ec-238e-4622-aee6-100a3d95d888 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:20.489705 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5def21ec-238e-4622-aee6-100a3d95d888 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.232455 Feb 10 03:39:20.491297 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 176/350] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:20 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:20.508716 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:20.510044 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:20.517729 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:20.518345 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:20.519320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:20.519894 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:20.680227 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:20.696161 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:20.697898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:20.699264 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2b389627-40f3-4134-9b2a-dee7468d73dc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.194325 Feb 10 03:39:20.710472 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 175/351] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:20 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:20.710761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5d45cf90-3cb9-4b94-b5cb-e37c22c73ea4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:20.710761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5d45cf90-3cb9-4b94-b5cb-e37c22c73ea4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:20.724751 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d45cf90-3cb9-4b94-b5cb-e37c22c73ea4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:20.725202 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d45cf90-3cb9-4b94-b5cb-e37c22c73ea4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:20.726013 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d45cf90-3cb9-4b94-b5cb-e37c22c73ea4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:20.726439 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d45cf90-3cb9-4b94-b5cb-e37c22c73ea4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:20.817607 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-09ae3086-3a85-4301-9e5b-294733cd13e5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:20.818684 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-09ae3086-3a85-4301-9e5b-294733cd13e5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:20.832109 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09ae3086-3a85-4301-9e5b-294733cd13e5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:20.833045 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09ae3086-3a85-4301-9e5b-294733cd13e5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:20.834104 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09ae3086-3a85-4301-9e5b-294733cd13e5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:20.834784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-09ae3086-3a85-4301-9e5b-294733cd13e5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:20.910490 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5d45cf90-3cb9-4b94-b5cb-e37c22c73ea4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:20.918441 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5d45cf90-3cb9-4b94-b5cb-e37c22c73ea4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.221298 Feb 10 03:39:20.931486 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 177/352] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:20 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:20.942395 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-09ae3086-3a85-4301-9e5b-294733cd13e5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:20.953170 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-09ae3086-3a85-4301-9e5b-294733cd13e5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1137 microversion: 2.1 time: 0.139263 Feb 10 03:39:20.953758 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 176/353] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:20 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1137 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:21.508430 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-103e9658-ea8c-4ed5-bb03-0a23ed0c5a06 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:21.509276 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-103e9658-ea8c-4ed5-bb03-0a23ed0c5a06 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:21.516150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-103e9658-ea8c-4ed5-bb03-0a23ed0c5a06 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:21.516627 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-103e9658-ea8c-4ed5-bb03-0a23ed0c5a06 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:21.517489 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-103e9658-ea8c-4ed5-bb03-0a23ed0c5a06 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:21.517986 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-103e9658-ea8c-4ed5-bb03-0a23ed0c5a06 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:21.717610 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:21.718248 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:21.726781 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-103e9658-ea8c-4ed5-bb03-0a23ed0c5a06 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:21.730342 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:21.730822 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:21.731966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:21.732087 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:21.740252 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-103e9658-ea8c-4ed5-bb03-0a23ed0c5a06 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.235217 Feb 10 03:39:21.741180 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 178/354] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:21 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:21.949268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1de8b857-642c-4074-a0c3-b0e19f42a362 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:21.952649 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1de8b857-642c-4074-a0c3-b0e19f42a362 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:21.964640 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1de8b857-642c-4074-a0c3-b0e19f42a362 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:21.965427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1de8b857-642c-4074-a0c3-b0e19f42a362 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:21.966678 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1de8b857-642c-4074-a0c3-b0e19f42a362 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:21.967339 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1de8b857-642c-4074-a0c3-b0e19f42a362 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:21.972511 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:21.984291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:21.987039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:21.988883 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-87cac57a-6105-46b4-bced-cab3f0f48a6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.275397 Feb 10 03:39:22.001572 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 177/355] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:21 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:22.007646 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-eb81e4cd-d29e-4f60-9d60-53097b01c6d0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:22.008654 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-eb81e4cd-d29e-4f60-9d60-53097b01c6d0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:22.018750 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb81e4cd-d29e-4f60-9d60-53097b01c6d0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:22.019954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb81e4cd-d29e-4f60-9d60-53097b01c6d0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:22.031834 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb81e4cd-d29e-4f60-9d60-53097b01c6d0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:22.037377 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb81e4cd-d29e-4f60-9d60-53097b01c6d0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:22.142941 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-eb81e4cd-d29e-4f60-9d60-53097b01c6d0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:22.152223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-eb81e4cd-d29e-4f60-9d60-53097b01c6d0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1211 microversion: 2.1 time: 0.149112 Feb 10 03:39:22.156337 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 178/356] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:22 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:22.223520 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1de8b857-642c-4074-a0c3-b0e19f42a362 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:22.234033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1de8b857-642c-4074-a0c3-b0e19f42a362 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.288360 Feb 10 03:39:22.234643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 179/357] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:21 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:22.759881 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4d5d9cce-5fc2-4529-8a29-7e78d3b50da7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:22.761038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4d5d9cce-5fc2-4529-8a29-7e78d3b50da7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:22.780715 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4d5d9cce-5fc2-4529-8a29-7e78d3b50da7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:22.781082 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4d5d9cce-5fc2-4529-8a29-7e78d3b50da7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:22.781904 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4d5d9cce-5fc2-4529-8a29-7e78d3b50da7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:22.782363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4d5d9cce-5fc2-4529-8a29-7e78d3b50da7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:22.985307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4d5d9cce-5fc2-4529-8a29-7e78d3b50da7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:22.993470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4d5d9cce-5fc2-4529-8a29-7e78d3b50da7 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.237251 Feb 10 03:39:22.995355 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 179/358] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:22 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:23.008773 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:23.011210 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:23.020719 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:23.022957 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:23.025874 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:23.026593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:23.173667 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-eaf195d9-21fa-4dcc-aa68-d51513373f41 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:23.174286 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-eaf195d9-21fa-4dcc-aa68-d51513373f41 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:23.182063 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eaf195d9-21fa-4dcc-aa68-d51513373f41 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:23.182512 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eaf195d9-21fa-4dcc-aa68-d51513373f41 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:23.183336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eaf195d9-21fa-4dcc-aa68-d51513373f41 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:23.188526 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eaf195d9-21fa-4dcc-aa68-d51513373f41 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:23.206135 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:23.216054 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:23.218041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:23.219672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-afc18f30-9ada-4f38-9077-1d399041e4c8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.214988 Feb 10 03:39:23.220875 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 180/359] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:23 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:23.254084 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-60cb8e86-92b4-4dc2-9d29-d270bbe4a93e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:23.254703 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-60cb8e86-92b4-4dc2-9d29-d270bbe4a93e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:23.264495 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-60cb8e86-92b4-4dc2-9d29-d270bbe4a93e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:23.267931 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-60cb8e86-92b4-4dc2-9d29-d270bbe4a93e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:23.268913 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-60cb8e86-92b4-4dc2-9d29-d270bbe4a93e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:23.269499 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-60cb8e86-92b4-4dc2-9d29-d270bbe4a93e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:23.476944 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-eaf195d9-21fa-4dcc-aa68-d51513373f41 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:23.487431 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-eaf195d9-21fa-4dcc-aa68-d51513373f41 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1278 microversion: 2.1 time: 0.317470 Feb 10 03:39:23.491388 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-60cb8e86-92b4-4dc2-9d29-d270bbe4a93e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:23.498005 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 180/360] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:23 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1278 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:23.514551 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-60cb8e86-92b4-4dc2-9d29-d270bbe4a93e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.258792 Feb 10 03:39:23.515215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 181/361] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:23 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:23.864975 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-9ddbaf8c-9c98-47cb-9159-049b0a5fc934 req-f3408e60-d5fc-4880-b8dc-3be687412fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6526425c-4ed8-4fc2-982e-cfa3c75087c3", "tag": "336de512-11fe-4594-b1b4-1b948f7eceab"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:23.868406 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:23.868406 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:39:23.882813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-9ddbaf8c-9c98-47cb-9159-049b0a5fc934 req-f3408e60-d5fc-4880-b8dc-3be687412fed service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:23.883577 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-9ddbaf8c-9c98-47cb-9159-049b0a5fc934 req-f3408e60-d5fc-4880-b8dc-3be687412fed service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:23.899274 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-9ddbaf8c-9c98-47cb-9159-049b0a5fc934 req-f3408e60-d5fc-4880-b8dc-3be687412fed service nova] Creating event network-changed:336de512-11fe-4594-b1b4-1b948f7eceab for instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 on hv-cinder-82806 Feb 10 03:39:23.907414 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-9ddbaf8c-9c98-47cb-9159-049b0a5fc934 req-f3408e60-d5fc-4880-b8dc-3be687412fed service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047502 Feb 10 03:39:23.908887 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 181/362] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:24.012971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3430e330-fab4-43c3-ab00-1e12b939891d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:24.014328 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3430e330-fab4-43c3-ab00-1e12b939891d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:24.024850 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3430e330-fab4-43c3-ab00-1e12b939891d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:24.025308 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3430e330-fab4-43c3-ab00-1e12b939891d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:24.026113 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3430e330-fab4-43c3-ab00-1e12b939891d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:24.026547 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3430e330-fab4-43c3-ab00-1e12b939891d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:24.238561 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:24.239300 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:24.243015 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3430e330-fab4-43c3-ab00-1e12b939891d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:24.247143 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:24.247605 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:24.248448 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:24.249091 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:24.254617 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3430e330-fab4-43c3-ab00-1e12b939891d tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.244629 Feb 10 03:39:24.257406 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 182/363] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:24 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:24.434877 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:24.443543 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:24.445101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:24.447833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-20463db1-94c9-49b6-8b64-732821405378 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.212192 Feb 10 03:39:24.459520 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 182/364] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:24 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:24.505062 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c4a30236-e86a-4d61-a3ee-ea7ca3db8a5c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:24.505761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c4a30236-e86a-4d61-a3ee-ea7ca3db8a5c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:24.515039 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c4a30236-e86a-4d61-a3ee-ea7ca3db8a5c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:24.515606 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c4a30236-e86a-4d61-a3ee-ea7ca3db8a5c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:24.516693 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c4a30236-e86a-4d61-a3ee-ea7ca3db8a5c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:24.517442 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c4a30236-e86a-4d61-a3ee-ea7ca3db8a5c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:24.532864 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-57ce63f7-30db-4ba4-a071-1f734ca5924a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:24.533827 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-57ce63f7-30db-4ba4-a071-1f734ca5924a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:24.546033 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57ce63f7-30db-4ba4-a071-1f734ca5924a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:24.546737 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57ce63f7-30db-4ba4-a071-1f734ca5924a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:24.547739 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57ce63f7-30db-4ba4-a071-1f734ca5924a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:24.548279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57ce63f7-30db-4ba4-a071-1f734ca5924a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:24.825569 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-57ce63f7-30db-4ba4-a071-1f734ca5924a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:24.834991 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-57ce63f7-30db-4ba4-a071-1f734ca5924a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.305386 Feb 10 03:39:24.835223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 183/365] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:24 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:24.891883 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c4a30236-e86a-4d61-a3ee-ea7ca3db8a5c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:24.902584 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c4a30236-e86a-4d61-a3ee-ea7ca3db8a5c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1278 microversion: 2.1 time: 0.401357 Feb 10 03:39:24.903211 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 183/366] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:24 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1278 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:25.273433 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f94ff054-1ef9-4855-918b-f7891b4beb8e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:25.274124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f94ff054-1ef9-4855-918b-f7891b4beb8e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:25.283323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f94ff054-1ef9-4855-918b-f7891b4beb8e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.286073 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f94ff054-1ef9-4855-918b-f7891b4beb8e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:25.287245 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f94ff054-1ef9-4855-918b-f7891b4beb8e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.287937 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f94ff054-1ef9-4855-918b-f7891b4beb8e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:25.467851 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:25.468580 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:25.479347 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.480169 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:25.481372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.482052 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:25.494854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f94ff054-1ef9-4855-918b-f7891b4beb8e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:25.504366 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f94ff054-1ef9-4855-918b-f7891b4beb8e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.234562 Feb 10 03:39:25.505598 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 184/367] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:25 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:25.697029 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-98f5410b-0442-4f95-88f7-ff5cd4ae835b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:25.704724 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-98f5410b-0442-4f95-88f7-ff5cd4ae835b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.705314 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-98f5410b-0442-4f95-88f7-ff5cd4ae835b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:25.775389 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-98f5410b-0442-4f95-88f7-ff5cd4ae835b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Going to try to stop instance {{(pid=127951) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 10 03:39:25.780509 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:25.788685 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:25.797936 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:25.805446 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-854e5634-e220-480d-8c31-b8769a09d09a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.341027 Feb 10 03:39:25.807594 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 184/368] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:25 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:25.829134 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-98f5410b-0442-4f95-88f7-ff5cd4ae835b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/action" status: 202 len: 0 microversion: 2.1 time: 0.143390 Feb 10 03:39:25.830399 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 185/369] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:39:25 2022] POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:39:25.838954 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-26cc8051-5781-4368-9a20-1d016e694e8b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:25.840004 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-26cc8051-5781-4368-9a20-1d016e694e8b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:25.851463 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26cc8051-5781-4368-9a20-1d016e694e8b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.852616 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26cc8051-5781-4368-9a20-1d016e694e8b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:25.853786 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26cc8051-5781-4368-9a20-1d016e694e8b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.854485 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26cc8051-5781-4368-9a20-1d016e694e8b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:25.858733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-574089fe-4e2f-47ee-afb5-9fa4a1e73dfa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:25.859449 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-574089fe-4e2f-47ee-afb5-9fa4a1e73dfa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:25.868514 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-574089fe-4e2f-47ee-afb5-9fa4a1e73dfa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.869227 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-574089fe-4e2f-47ee-afb5-9fa4a1e73dfa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:25.870203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-574089fe-4e2f-47ee-afb5-9fa4a1e73dfa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:25.871204 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-574089fe-4e2f-47ee-afb5-9fa4a1e73dfa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:26.060645 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-26cc8051-5781-4368-9a20-1d016e694e8b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:26.072481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-26cc8051-5781-4368-9a20-1d016e694e8b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.237559 Feb 10 03:39:26.074016 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 185/370] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:25 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:26.078724 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a1d88920-6283-471c-bf53-efebf99c8360 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:26.079585 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a1d88920-6283-471c-bf53-efebf99c8360 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:26.092154 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1d88920-6283-471c-bf53-efebf99c8360 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:26.092804 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1d88920-6283-471c-bf53-efebf99c8360 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:26.094189 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1d88920-6283-471c-bf53-efebf99c8360 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:26.094903 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1d88920-6283-471c-bf53-efebf99c8360 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:26.183238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-574089fe-4e2f-47ee-afb5-9fa4a1e73dfa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:26.193243 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-574089fe-4e2f-47ee-afb5-9fa4a1e73dfa tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.343264 Feb 10 03:39:26.194356 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 186/371] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:25 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:26.209063 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-43686680-27ab-492b-9e8f-25bb2580df74 req-4495cd32-eb04-4730-b4a8-6621afed2a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2d5f1-131a-4713-9d41-f99e7b3897c7", "name": "network-vif-plugged", "status": "completed", "tag": "b590bb01-bf48-4666-8123-155cb2cc0ab8"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:26.210710 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:26.210710 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:39:26.218175 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-43686680-27ab-492b-9e8f-25bb2580df74 req-4495cd32-eb04-4730-b4a8-6621afed2a61 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:26.218619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-43686680-27ab-492b-9e8f-25bb2580df74 req-4495cd32-eb04-4730-b4a8-6621afed2a61 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:26.237457 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-43686680-27ab-492b-9e8f-25bb2580df74 req-4495cd32-eb04-4730-b4a8-6621afed2a61 service nova] Creating event network-vif-plugged:b590bb01-bf48-4666-8123-155cb2cc0ab8 for instance 49b2d5f1-131a-4713-9d41-f99e7b3897c7 on hv-cinder-82806 Feb 10 03:39:26.242317 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-43686680-27ab-492b-9e8f-25bb2580df74 req-4495cd32-eb04-4730-b4a8-6621afed2a61 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037278 Feb 10 03:39:26.242997 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 187/372] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:26.268936 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a1d88920-6283-471c-bf53-efebf99c8360 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:26.276564 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a1d88920-6283-471c-bf53-efebf99c8360 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1278 microversion: 2.1 time: 0.201197 Feb 10 03:39:26.277160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 186/373] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:26 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:26.522959 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fe4c29a6-a79d-462a-be30-1fcf0f9b7b77 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:26.524514 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fe4c29a6-a79d-462a-be30-1fcf0f9b7b77 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:26.532970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fe4c29a6-a79d-462a-be30-1fcf0f9b7b77 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:26.533547 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fe4c29a6-a79d-462a-be30-1fcf0f9b7b77 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:26.534591 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fe4c29a6-a79d-462a-be30-1fcf0f9b7b77 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:26.535202 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fe4c29a6-a79d-462a-be30-1fcf0f9b7b77 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:26.778631 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fe4c29a6-a79d-462a-be30-1fcf0f9b7b77 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:26.791476 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fe4c29a6-a79d-462a-be30-1fcf0f9b7b77 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.273604 Feb 10 03:39:26.792319 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 188/374] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:26 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:26.825710 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:26.826701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:26.834289 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:26.834833 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:26.835830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:26.836570 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:26.997533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:27.006278 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:27.007844 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:27.009324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ad683a76-bf16-400b-9c7f-4fff50734594 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1743 microversion: 2.20 time: 0.187464 Feb 10 03:39:27.009885 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 187/375] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:26 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:27.089966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2d372369-2c2b-4f17-82a0-4485fbc1bfaf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:27.090637 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-2d372369-2c2b-4f17-82a0-4485fbc1bfaf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:27.097967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2d372369-2c2b-4f17-82a0-4485fbc1bfaf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:27.098425 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2d372369-2c2b-4f17-82a0-4485fbc1bfaf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:27.099581 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2d372369-2c2b-4f17-82a0-4485fbc1bfaf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:27.099699 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2d372369-2c2b-4f17-82a0-4485fbc1bfaf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:27.213002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-bb567649-46a6-4ed9-abd9-6f40298e03e8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:27.214278 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-bb567649-46a6-4ed9-abd9-6f40298e03e8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:27.221640 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bb567649-46a6-4ed9-abd9-6f40298e03e8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:27.222300 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bb567649-46a6-4ed9-abd9-6f40298e03e8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:27.223355 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bb567649-46a6-4ed9-abd9-6f40298e03e8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:27.224198 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bb567649-46a6-4ed9-abd9-6f40298e03e8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:27.320342 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2d372369-2c2b-4f17-82a0-4485fbc1bfaf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:27.329361 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2d372369-2c2b-4f17-82a0-4485fbc1bfaf tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.243560 Feb 10 03:39:27.340029 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 189/376] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:27 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:27.345274 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c7b97e48-a4e6-4754-9246-0a3b9cf42820 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:27.345915 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c7b97e48-a4e6-4754-9246-0a3b9cf42820 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:27.352982 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c7b97e48-a4e6-4754-9246-0a3b9cf42820 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:27.353334 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c7b97e48-a4e6-4754-9246-0a3b9cf42820 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:27.354171 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c7b97e48-a4e6-4754-9246-0a3b9cf42820 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:27.354596 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c7b97e48-a4e6-4754-9246-0a3b9cf42820 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:27.460477 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-bb567649-46a6-4ed9-abd9-6f40298e03e8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:27.469445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-bb567649-46a6-4ed9-abd9-6f40298e03e8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.261763 Feb 10 03:39:27.470019 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 188/377] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:27 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:27.543561 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c7b97e48-a4e6-4754-9246-0a3b9cf42820 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:27.551727 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c7b97e48-a4e6-4754-9246-0a3b9cf42820 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.210542 Feb 10 03:39:27.552323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 190/378] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:27 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:27.809410 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2765b4bb-dd5b-4c48-9143-19c83104aede tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:27.810043 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2765b4bb-dd5b-4c48-9143-19c83104aede tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:27.816581 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2765b4bb-dd5b-4c48-9143-19c83104aede tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:27.817031 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2765b4bb-dd5b-4c48-9143-19c83104aede tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:27.817813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2765b4bb-dd5b-4c48-9143-19c83104aede tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:27.818250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2765b4bb-dd5b-4c48-9143-19c83104aede tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.020559 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2765b4bb-dd5b-4c48-9143-19c83104aede tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:28.028360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:28.028977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:28.037115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2765b4bb-dd5b-4c48-9143-19c83104aede tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1317 microversion: 2.1 time: 0.231413 Feb 10 03:39:28.037713 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 189/379] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:27 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:28.043829 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:28.044731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.045717 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:28.046152 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.212633 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:28.224135 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:28.226399 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:28.230379 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d92c0459-a83f-4b46-9aff-0e237d04b639 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1743 microversion: 2.20 time: 0.203183 Feb 10 03:39:28.230379 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 191/380] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:28 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:28.347043 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d7bdd7be-4eac-4cdf-b10a-a4796d82b10a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:28.347665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d7bdd7be-4eac-4cdf-b10a-a4796d82b10a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:28.354430 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7bdd7be-4eac-4cdf-b10a-a4796d82b10a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:28.356564 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7bdd7be-4eac-4cdf-b10a-a4796d82b10a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.357445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7bdd7be-4eac-4cdf-b10a-a4796d82b10a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:28.357948 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7bdd7be-4eac-4cdf-b10a-a4796d82b10a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.485796 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dd7a64e0-c50a-4025-8a7a-f161fd420d3f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:28.486505 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dd7a64e0-c50a-4025-8a7a-f161fd420d3f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:28.495520 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd7a64e0-c50a-4025-8a7a-f161fd420d3f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:28.496441 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd7a64e0-c50a-4025-8a7a-f161fd420d3f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.497389 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd7a64e0-c50a-4025-8a7a-f161fd420d3f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:28.497931 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd7a64e0-c50a-4025-8a7a-f161fd420d3f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.530768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d7bdd7be-4eac-4cdf-b10a-a4796d82b10a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:28.544806 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d7bdd7be-4eac-4cdf-b10a-a4796d82b10a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.201489 Feb 10 03:39:28.546574 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 190/381] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:28 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:28.569214 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0c2fe6b8-8264-4050-b7ff-b9c771b41aa5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:28.569902 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0c2fe6b8-8264-4050-b7ff-b9c771b41aa5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:28.576916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0c2fe6b8-8264-4050-b7ff-b9c771b41aa5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:28.577477 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0c2fe6b8-8264-4050-b7ff-b9c771b41aa5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.578633 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0c2fe6b8-8264-4050-b7ff-b9c771b41aa5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:28.579190 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0c2fe6b8-8264-4050-b7ff-b9c771b41aa5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:28.792074 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dd7a64e0-c50a-4025-8a7a-f161fd420d3f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:28.803407 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dd7a64e0-c50a-4025-8a7a-f161fd420d3f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.321338 Feb 10 03:39:28.813524 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 192/382] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:28 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:28.865600 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0c2fe6b8-8264-4050-b7ff-b9c771b41aa5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:28.876615 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0c2fe6b8-8264-4050-b7ff-b9c771b41aa5 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.311278 Feb 10 03:39:28.877515 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 191/383] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:28 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:29.054404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a5f165d0-5a10-467b-a1b8-041834e6f88f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:29.055306 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a5f165d0-5a10-467b-a1b8-041834e6f88f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:29.065551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a5f165d0-5a10-467b-a1b8-041834e6f88f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.067961 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a5f165d0-5a10-467b-a1b8-041834e6f88f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.069331 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a5f165d0-5a10-467b-a1b8-041834e6f88f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.069960 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a5f165d0-5a10-467b-a1b8-041834e6f88f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.246600 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:29.247993 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:29.255566 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a5f165d0-5a10-467b-a1b8-041834e6f88f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:29.256369 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.256815 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.257617 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.258040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.263301 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a5f165d0-5a10-467b-a1b8-041834e6f88f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1506 microversion: 2.1 time: 0.212654 Feb 10 03:39:29.274600 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 193/384] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:29 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:29.408577 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:29.418933 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:29.421033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:29.422494 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-eeecc1b7-de01-4e0b-8787-719aeffd889b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1743 microversion: 2.20 time: 0.180210 Feb 10 03:39:29.426698 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 192/385] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:29 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:29.563435 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-51edb4bb-fed1-493e-9909-43a1bb862e3d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:29.564323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-51edb4bb-fed1-493e-9909-43a1bb862e3d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:29.577169 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-51edb4bb-fed1-493e-9909-43a1bb862e3d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.577735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-51edb4bb-fed1-493e-9909-43a1bb862e3d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.578625 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-51edb4bb-fed1-493e-9909-43a1bb862e3d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.580222 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-51edb4bb-fed1-493e-9909-43a1bb862e3d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.764412 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-51edb4bb-fed1-493e-9909-43a1bb862e3d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:29.776514 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-51edb4bb-fed1-493e-9909-43a1bb862e3d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.217757 Feb 10 03:39:29.777402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 194/386] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:29 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:29.820494 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1a131e66-6d23-4326-a056-400d44912a30 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:29.821103 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1a131e66-6d23-4326-a056-400d44912a30 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:29.827334 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a131e66-6d23-4326-a056-400d44912a30 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.828115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a131e66-6d23-4326-a056-400d44912a30 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.829479 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a131e66-6d23-4326-a056-400d44912a30 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.830250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a131e66-6d23-4326-a056-400d44912a30 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.897406 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-5fe6653e-66d2-47f4-9bb6-d7898ad83cd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:29.898265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-5fe6653e-66d2-47f4-9bb6-d7898ad83cd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:29.905069 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5fe6653e-66d2-47f4-9bb6-d7898ad83cd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.905513 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5fe6653e-66d2-47f4-9bb6-d7898ad83cd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:29.906344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5fe6653e-66d2-47f4-9bb6-d7898ad83cd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:29.906892 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5fe6653e-66d2-47f4-9bb6-d7898ad83cd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:30.006821 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1a131e66-6d23-4326-a056-400d44912a30 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:30.028145 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1a131e66-6d23-4326-a056-400d44912a30 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.211267 Feb 10 03:39:30.028889 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 193/387] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:29 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:30.077639 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-5fe6653e-66d2-47f4-9bb6-d7898ad83cd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:30.087104 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-5fe6653e-66d2-47f4-9bb6-d7898ad83cd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.196879 Feb 10 03:39:30.087831 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 195/388] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:29 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:30.441051 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:30.442417 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:30.449036 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:30.449560 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:30.450630 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:30.451296 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:30.638434 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:30.647777 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:30.649648 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:30.651251 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7495d57d-4569-4a89-8bc3-344474dfbf6f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.214180 Feb 10 03:39:30.663813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 194/389] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:30 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:30.742349 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c89e46d0-0050-49a5-bbaa-2b60a20a423f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dc5fd63-fc12-4a40-a2ad-e5cdb25b47ac"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:30.743923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c89e46d0-0050-49a5-bbaa-2b60a20a423f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:30.751079 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c89e46d0-0050-49a5-bbaa-2b60a20a423f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:30.752405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c89e46d0-0050-49a5-bbaa-2b60a20a423f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:30.754260 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c89e46d0-0050-49a5-bbaa-2b60a20a423f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:30.755492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c89e46d0-0050-49a5-bbaa-2b60a20a423f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:30.794429 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8bfa3245-b061-4efc-bc29-dfa994771e55 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:30.795676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8bfa3245-b061-4efc-bc29-dfa994771e55 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:30.803131 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8bfa3245-b061-4efc-bc29-dfa994771e55 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:30.803867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8bfa3245-b061-4efc-bc29-dfa994771e55 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:30.804940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8bfa3245-b061-4efc-bc29-dfa994771e55 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:30.805772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8bfa3245-b061-4efc-bc29-dfa994771e55 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:31.203895 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8bfa3245-b061-4efc-bc29-dfa994771e55 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:31.219895 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8bfa3245-b061-4efc-bc29-dfa994771e55 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.430026 Feb 10 03:39:31.224830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 195/390] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:30 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:31.236453 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8e977a51-7423-4439-a325-c1ad59c5151a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:31.237639 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8e977a51-7423-4439-a325-c1ad59c5151a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:31.263486 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8e977a51-7423-4439-a325-c1ad59c5151a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:31.264882 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8e977a51-7423-4439-a325-c1ad59c5151a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:31.269513 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8e977a51-7423-4439-a325-c1ad59c5151a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:31.271345 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8e977a51-7423-4439-a325-c1ad59c5151a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:31.292562 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c89e46d0-0050-49a5-bbaa-2b60a20a423f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "POST /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.554783 Feb 10 03:39:31.299300 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 196/391] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:39:30 2022] POST /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:31.315473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-cf96c7f5-2ccb-4e3e-85be-064743a41dcb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:31.323877 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-cf96c7f5-2ccb-4e3e-85be-064743a41dcb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:31.358509 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cf96c7f5-2ccb-4e3e-85be-064743a41dcb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:31.360613 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cf96c7f5-2ccb-4e3e-85be-064743a41dcb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:31.361677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cf96c7f5-2ccb-4e3e-85be-064743a41dcb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:31.378468 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cf96c7f5-2ccb-4e3e-85be-064743a41dcb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:31.859022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8e977a51-7423-4439-a325-c1ad59c5151a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:31.869990 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8e977a51-7423-4439-a325-c1ad59c5151a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.640834 Feb 10 03:39:31.871005 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 196/392] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:31 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:31.891701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:31.895212 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:31.912414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:31.913151 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:31.914124 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:31.914913 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:31.943477 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cf96c7f5-2ccb-4e3e-85be-064743a41dcb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:31.957244 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-cf96c7f5-2ccb-4e3e-85be-064743a41dcb tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.656365 Feb 10 03:39:31.958050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 197/393] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:31 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:32.185701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:32.196065 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:32.203683 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:32.205190 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-948fdd72-3422-494c-81a9-eefbcda79b68 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.321266 Feb 10 03:39:32.212226 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 197/394] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:31 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:32.240817 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-abf9a179-66f9-494d-8a53-b635915d9218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:32.241531 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-abf9a179-66f9-494d-8a53-b635915d9218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:32.253596 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-abf9a179-66f9-494d-8a53-b635915d9218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:32.259303 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-abf9a179-66f9-494d-8a53-b635915d9218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:32.260363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-abf9a179-66f9-494d-8a53-b635915d9218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:32.260885 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-abf9a179-66f9-494d-8a53-b635915d9218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:32.316198 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-95ce87a1-128d-40b2-9131-6b067b23bbb9 req-57052e4c-a53f-45c8-ac74-ad6cbebc9276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d302b3d4-6282-4fbe-a4c4-248881ee8f51", "name": "network-vif-plugged", "status": "completed", "tag": "29a0a5b3-6729-4753-8ce5-55f51a8c9a2e"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:32.318389 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:32.318389 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:39:32.332492 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-95ce87a1-128d-40b2-9131-6b067b23bbb9 req-57052e4c-a53f-45c8-ac74-ad6cbebc9276 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:32.333991 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-95ce87a1-128d-40b2-9131-6b067b23bbb9 req-57052e4c-a53f-45c8-ac74-ad6cbebc9276 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:32.355194 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-95ce87a1-128d-40b2-9131-6b067b23bbb9 req-57052e4c-a53f-45c8-ac74-ad6cbebc9276 service nova] Creating event network-vif-plugged:29a0a5b3-6729-4753-8ce5-55f51a8c9a2e for instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 on hv-cinder-82806 Feb 10 03:39:32.374943 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-95ce87a1-128d-40b2-9131-6b067b23bbb9 req-57052e4c-a53f-45c8-ac74-ad6cbebc9276 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062034 Feb 10 03:39:32.377443 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 198/395] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:32.504619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-abf9a179-66f9-494d-8a53-b635915d9218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:32.515985 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-abf9a179-66f9-494d-8a53-b635915d9218 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.278982 Feb 10 03:39:32.516846 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 198/396] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:32 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:32.888746 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-da7d44c2-d111-4811-bab3-d6b875e5c289 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:32.890553 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-da7d44c2-d111-4811-bab3-d6b875e5c289 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:32.898373 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-da7d44c2-d111-4811-bab3-d6b875e5c289 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:32.899263 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-da7d44c2-d111-4811-bab3-d6b875e5c289 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:32.900151 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-da7d44c2-d111-4811-bab3-d6b875e5c289 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:32.900877 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-da7d44c2-d111-4811-bab3-d6b875e5c289 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:32.973804 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3548554a-1020-4478-a07a-8c6ab5ae447c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:32.975085 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3548554a-1020-4478-a07a-8c6ab5ae447c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:32.990360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3548554a-1020-4478-a07a-8c6ab5ae447c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:32.991288 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3548554a-1020-4478-a07a-8c6ab5ae447c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:32.992374 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3548554a-1020-4478-a07a-8c6ab5ae447c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:32.993113 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3548554a-1020-4478-a07a-8c6ab5ae447c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:33.151588 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-da7d44c2-d111-4811-bab3-d6b875e5c289 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:33.160164 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-da7d44c2-d111-4811-bab3-d6b875e5c289 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.275396 Feb 10 03:39:33.170591 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 199/397] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:32 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:33.232244 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:33.233371 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:33.244785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:33.245557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:33.248983 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:33.249619 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:33.310177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3548554a-1020-4478-a07a-8c6ab5ae447c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:33.325118 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3548554a-1020-4478-a07a-8c6ab5ae447c tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.355347 Feb 10 03:39:33.325974 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 199/398] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:32 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:33.460888 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:33.473179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:33.475809 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:33.477085 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-79c2be43-d338-4f8b-88a6-1d32f5eef493 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.249362 Feb 10 03:39:33.491554 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 200/399] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:33 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:33.533727 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ddf40481-f2c6-40be-a2ea-29f117cdc938 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:33.534369 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ddf40481-f2c6-40be-a2ea-29f117cdc938 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:33.551799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ddf40481-f2c6-40be-a2ea-29f117cdc938 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:33.552328 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ddf40481-f2c6-40be-a2ea-29f117cdc938 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:33.552960 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ddf40481-f2c6-40be-a2ea-29f117cdc938 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:33.553405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ddf40481-f2c6-40be-a2ea-29f117cdc938 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:33.836689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ddf40481-f2c6-40be-a2ea-29f117cdc938 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:33.846158 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ddf40481-f2c6-40be-a2ea-29f117cdc938 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.316127 Feb 10 03:39:33.847461 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 200/400] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:33 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:34.178210 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1a83303e-724c-4713-a799-d4e4b8215f0d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:34.179715 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1a83303e-724c-4713-a799-d4e4b8215f0d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:34.192199 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a83303e-724c-4713-a799-d4e4b8215f0d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:34.193331 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a83303e-724c-4713-a799-d4e4b8215f0d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:34.194336 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a83303e-724c-4713-a799-d4e4b8215f0d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:34.194976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a83303e-724c-4713-a799-d4e4b8215f0d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:34.342417 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-60f71c19-29c4-4fac-a72f-c6e088c25e83 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:34.343051 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-60f71c19-29c4-4fac-a72f-c6e088c25e83 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:34.363416 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-60f71c19-29c4-4fac-a72f-c6e088c25e83 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:34.363876 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-60f71c19-29c4-4fac-a72f-c6e088c25e83 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:34.365030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-60f71c19-29c4-4fac-a72f-c6e088c25e83 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:34.365480 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-60f71c19-29c4-4fac-a72f-c6e088c25e83 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:34.398987 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1a83303e-724c-4713-a799-d4e4b8215f0d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:34.409159 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1a83303e-724c-4713-a799-d4e4b8215f0d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.234874 Feb 10 03:39:34.410599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 201/401] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:34 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:34.501127 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:34.501935 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:34.518266 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:34.518525 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:34.520205 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:34.520981 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:34.790369 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-60f71c19-29c4-4fac-a72f-c6e088c25e83 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:34.803022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-60f71c19-29c4-4fac-a72f-c6e088c25e83 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.463780 Feb 10 03:39:34.807046 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 201/402] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:34 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:34.824407 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:34.835869 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:34.837659 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:34.840639 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-63e2ab72-2616-47e2-bf8f-978b84a2c686 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.344936 Feb 10 03:39:34.840639 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 202/403] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:34 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:34.866025 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7c724adb-f0df-4bae-b68b-fb8a2260dd4a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:34.867366 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7c724adb-f0df-4bae-b68b-fb8a2260dd4a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:34.878104 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7c724adb-f0df-4bae-b68b-fb8a2260dd4a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:34.878832 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7c724adb-f0df-4bae-b68b-fb8a2260dd4a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:34.879813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7c724adb-f0df-4bae-b68b-fb8a2260dd4a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:34.880443 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7c724adb-f0df-4bae-b68b-fb8a2260dd4a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:35.185929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7c724adb-f0df-4bae-b68b-fb8a2260dd4a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:35.201763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7c724adb-f0df-4bae-b68b-fb8a2260dd4a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.340558 Feb 10 03:39:35.213812 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 202/404] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:34 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:35.434433 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5956672b-34da-4661-a792-ae41845ff60a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:35.435272 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5956672b-34da-4661-a792-ae41845ff60a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:35.443196 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5956672b-34da-4661-a792-ae41845ff60a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:35.443524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5956672b-34da-4661-a792-ae41845ff60a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:35.450867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5956672b-34da-4661-a792-ae41845ff60a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:35.452458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5956672b-34da-4661-a792-ae41845ff60a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:35.656314 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5956672b-34da-4661-a792-ae41845ff60a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:35.664143 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5956672b-34da-4661-a792-ae41845ff60a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.233504 Feb 10 03:39:35.685652 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 203/405] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:35 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:35.823906 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-91179d26-3051-4808-bbe5-5b58776b7bae tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:35.825507 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-91179d26-3051-4808-bbe5-5b58776b7bae tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:35.832283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-91179d26-3051-4808-bbe5-5b58776b7bae tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:35.839335 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-91179d26-3051-4808-bbe5-5b58776b7bae tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:35.840582 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-91179d26-3051-4808-bbe5-5b58776b7bae tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:35.841251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-91179d26-3051-4808-bbe5-5b58776b7bae tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:35.857106 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:35.857796 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:35.872654 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:35.873107 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:35.873988 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:35.874421 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:36.099245 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-91179d26-3051-4808-bbe5-5b58776b7bae tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:36.107884 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-91179d26-3051-4808-bbe5-5b58776b7bae tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.287640 Feb 10 03:39:36.112050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 203/406] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:35 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:36.154623 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:36.162671 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:36.164196 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:36.165353 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7851f8c8-9f23-42b9-9323-70aedfbcbeca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.311949 Feb 10 03:39:36.166129 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 204/407] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:35 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:36.234855 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-32ad49fc-0e99-4507-b051-9e57159a4b0c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:36.235669 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-32ad49fc-0e99-4507-b051-9e57159a4b0c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:36.248093 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-32ad49fc-0e99-4507-b051-9e57159a4b0c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:36.248721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-32ad49fc-0e99-4507-b051-9e57159a4b0c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:36.249618 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-32ad49fc-0e99-4507-b051-9e57159a4b0c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:36.250213 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-32ad49fc-0e99-4507-b051-9e57159a4b0c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:36.432778 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-32ad49fc-0e99-4507-b051-9e57159a4b0c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:36.442144 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-32ad49fc-0e99-4507-b051-9e57159a4b0c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.224392 Feb 10 03:39:36.452083 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 204/408] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:36 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:36.683420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-325ccf5e-97d3-409b-b72c-c7a5cd89914d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:36.684678 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-325ccf5e-97d3-409b-b72c-c7a5cd89914d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:36.693077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-325ccf5e-97d3-409b-b72c-c7a5cd89914d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:36.696148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-325ccf5e-97d3-409b-b72c-c7a5cd89914d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:36.698849 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-325ccf5e-97d3-409b-b72c-c7a5cd89914d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:36.700624 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-325ccf5e-97d3-409b-b72c-c7a5cd89914d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:36.871610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-325ccf5e-97d3-409b-b72c-c7a5cd89914d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:36.885107 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-325ccf5e-97d3-409b-b72c-c7a5cd89914d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.206219 Feb 10 03:39:36.885907 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 205/409] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:36 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:37.129017 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e2550d2c-7532-4465-8969-681a70ff398e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:37.130605 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e2550d2c-7532-4465-8969-681a70ff398e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:37.137135 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e2550d2c-7532-4465-8969-681a70ff398e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:37.137895 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e2550d2c-7532-4465-8969-681a70ff398e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:37.138950 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e2550d2c-7532-4465-8969-681a70ff398e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:37.139581 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e2550d2c-7532-4465-8969-681a70ff398e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:37.184221 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:37.185147 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:37.199771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:37.200570 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:37.201598 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:37.202217 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:37.355146 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e2550d2c-7532-4465-8969-681a70ff398e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:37.363910 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e2550d2c-7532-4465-8969-681a70ff398e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.238498 Feb 10 03:39:37.365260 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 205/410] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:37 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:37.426957 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:37.436830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:37.438534 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:37.439784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7ea22f5e-16f2-451f-be72-58d5a068d46f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.259532 Feb 10 03:39:37.440846 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 206/411] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:37 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:37.460959 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b497fdfe-483e-4456-ae89-bff99ebfd551 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:37.461675 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b497fdfe-483e-4456-ae89-bff99ebfd551 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:37.467968 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b497fdfe-483e-4456-ae89-bff99ebfd551 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:37.468499 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b497fdfe-483e-4456-ae89-bff99ebfd551 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:37.469359 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b497fdfe-483e-4456-ae89-bff99ebfd551 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:37.469863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b497fdfe-483e-4456-ae89-bff99ebfd551 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:37.628360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b497fdfe-483e-4456-ae89-bff99ebfd551 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:37.640133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b497fdfe-483e-4456-ae89-bff99ebfd551 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.183865 Feb 10 03:39:37.640718 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 206/412] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:37 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:37.902630 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3c8667d7-d5c2-4398-8b0b-ca84092ec5f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:37.903952 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3c8667d7-d5c2-4398-8b0b-ca84092ec5f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:37.924123 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3c8667d7-d5c2-4398-8b0b-ca84092ec5f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:37.924705 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3c8667d7-d5c2-4398-8b0b-ca84092ec5f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:37.925606 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3c8667d7-d5c2-4398-8b0b-ca84092ec5f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:37.926147 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3c8667d7-d5c2-4398-8b0b-ca84092ec5f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:38.100247 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3c8667d7-d5c2-4398-8b0b-ca84092ec5f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:38.111565 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3c8667d7-d5c2-4398-8b0b-ca84092ec5f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.212953 Feb 10 03:39:38.112435 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 207/413] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:37 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:38.381503 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ef79c37a-7008-489f-9020-d04f51cb1ae1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:38.382912 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ef79c37a-7008-489f-9020-d04f51cb1ae1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:38.391497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ef79c37a-7008-489f-9020-d04f51cb1ae1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:38.392118 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ef79c37a-7008-489f-9020-d04f51cb1ae1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:38.393044 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ef79c37a-7008-489f-9020-d04f51cb1ae1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:38.393828 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ef79c37a-7008-489f-9020-d04f51cb1ae1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:38.458047 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:38.459308 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:38.468114 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:38.468908 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:38.469920 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:38.470546 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:38.608812 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ef79c37a-7008-489f-9020-d04f51cb1ae1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:38.622904 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ef79c37a-7008-489f-9020-d04f51cb1ae1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.245000 Feb 10 03:39:38.623889 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 207/414] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:38 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:38.657455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d1d5afa6-18a2-4018-9d9b-13c6caa4dbe1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:38.658607 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d1d5afa6-18a2-4018-9d9b-13c6caa4dbe1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:38.673380 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d1d5afa6-18a2-4018-9d9b-13c6caa4dbe1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:38.674364 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d1d5afa6-18a2-4018-9d9b-13c6caa4dbe1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:38.675574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d1d5afa6-18a2-4018-9d9b-13c6caa4dbe1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:38.677846 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d1d5afa6-18a2-4018-9d9b-13c6caa4dbe1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:38.695404 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:38.704431 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:38.706236 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:38.707663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-405dce83-0f4e-423a-9a3c-2bb84cda63af tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.253557 Feb 10 03:39:38.719004 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 208/415] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:38 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:38.832223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d1d5afa6-18a2-4018-9d9b-13c6caa4dbe1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:38.840790 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d1d5afa6-18a2-4018-9d9b-13c6caa4dbe1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.187140 Feb 10 03:39:38.841693 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 208/416] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:38 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:39.130215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7d5bcc8d-19a5-4a64-8fed-00c0a442d80b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:39.130922 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7d5bcc8d-19a5-4a64-8fed-00c0a442d80b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:39.148284 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d5bcc8d-19a5-4a64-8fed-00c0a442d80b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:39.148761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d5bcc8d-19a5-4a64-8fed-00c0a442d80b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:39.150922 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d5bcc8d-19a5-4a64-8fed-00c0a442d80b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:39.151572 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d5bcc8d-19a5-4a64-8fed-00c0a442d80b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:39.308390 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7d5bcc8d-19a5-4a64-8fed-00c0a442d80b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:39.318636 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7d5bcc8d-19a5-4a64-8fed-00c0a442d80b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.192937 Feb 10 03:39:39.328288 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 209/417] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:39 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:39.639924 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-69d5e4fd-5610-4522-a1ef-b7465bc2014e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:39.641159 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-69d5e4fd-5610-4522-a1ef-b7465bc2014e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:39.647465 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-69d5e4fd-5610-4522-a1ef-b7465bc2014e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:39.649678 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-69d5e4fd-5610-4522-a1ef-b7465bc2014e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:39.654957 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-69d5e4fd-5610-4522-a1ef-b7465bc2014e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:39.655633 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-69d5e4fd-5610-4522-a1ef-b7465bc2014e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:39.725926 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:39.726579 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:39.739687 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:39.740502 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:39.741734 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:39.742458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.098542 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-69d5e4fd-5610-4522-a1ef-b7465bc2014e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:40.102781 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:40.109343 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-69d5e4fd-5610-4522-a1ef-b7465bc2014e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.473171 Feb 10 03:39:40.110897 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 209/418] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:39 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:40.111542 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:40.113409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:40.114972 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6f458f3e-cabc-4c7e-a470-e838218e723e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.392991 Feb 10 03:39:40.115986 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 210/419] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:39 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:40.119083 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-22c5c3e8-30e1-4cb0-92d1-f95d4daad045 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:40.119705 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-22c5c3e8-30e1-4cb0-92d1-f95d4daad045 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:40.121230 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-7f7f11c9-07d2-488b-bf49-66954f6b3e8b req-6e8982fb-f063-4636-b6f6-cac85e9e1a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6526425c-4ed8-4fc2-982e-cfa3c75087c3", "name": "network-vif-plugged", "status": "completed", "tag": "336de512-11fe-4594-b1b4-1b948f7eceab"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:40.123226 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:40.123226 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:39:40.127486 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-22c5c3e8-30e1-4cb0-92d1-f95d4daad045 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.127926 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-22c5c3e8-30e1-4cb0-92d1-f95d4daad045 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.128832 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-22c5c3e8-30e1-4cb0-92d1-f95d4daad045 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.129284 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-22c5c3e8-30e1-4cb0-92d1-f95d4daad045 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.133065 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-7f7f11c9-07d2-488b-bf49-66954f6b3e8b req-6e8982fb-f063-4636-b6f6-cac85e9e1a0f service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.134079 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-7f7f11c9-07d2-488b-bf49-66954f6b3e8b req-6e8982fb-f063-4636-b6f6-cac85e9e1a0f service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.156331 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-7f7f11c9-07d2-488b-bf49-66954f6b3e8b req-6e8982fb-f063-4636-b6f6-cac85e9e1a0f service nova] Creating event network-vif-plugged:336de512-11fe-4594-b1b4-1b948f7eceab for instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 on hv-cinder-82806 Feb 10 03:39:40.173008 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-7f7f11c9-07d2-488b-bf49-66954f6b3e8b req-6e8982fb-f063-4636-b6f6-cac85e9e1a0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046835 Feb 10 03:39:40.173008 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 211/420] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:40.300929 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-586b580a-e30b-410b-904b-f35706892256 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:40.301650 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-586b580a-e30b-410b-904b-f35706892256 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:40.309353 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-586b580a-e30b-410b-904b-f35706892256 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.309808 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-586b580a-e30b-410b-904b-f35706892256 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.310772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-586b580a-e30b-410b-904b-f35706892256 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.311303 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-586b580a-e30b-410b-904b-f35706892256 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.378362 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-22c5c3e8-30e1-4cb0-92d1-f95d4daad045 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:40.393954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-22c5c3e8-30e1-4cb0-92d1-f95d4daad045 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.281980 Feb 10 03:39:40.394835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 210/421] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:40 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:40.400260 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7dec2021-8f5a-4bde-b68e-bcbf155755f5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:40.401050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7dec2021-8f5a-4bde-b68e-bcbf155755f5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:40.415826 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7dec2021-8f5a-4bde-b68e-bcbf155755f5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.416278 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7dec2021-8f5a-4bde-b68e-bcbf155755f5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.417067 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7dec2021-8f5a-4bde-b68e-bcbf155755f5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.417501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7dec2021-8f5a-4bde-b68e-bcbf155755f5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.545732 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-586b580a-e30b-410b-904b-f35706892256 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lazy-loading 'services' on Instance uuid 49b2d5f1-131a-4713-9d41-f99e7b3897c7 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:39:40.738013 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7dec2021-8f5a-4bde-b68e-bcbf155755f5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:40.757757 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-586b580a-e30b-410b-904b-f35706892256 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments/4dc5fd63-fc12-4a40-a2ad-e5cdb25b47ac" status: 202 len: 0 microversion: 2.1 time: 0.461179 Feb 10 03:39:40.758599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 212/422] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:39:40 2022] DELETE /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments/4dc5fd63-fc12-4a40-a2ad-e5cdb25b47ac => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 10 03:39:40.761607 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7dec2021-8f5a-4bde-b68e-bcbf155755f5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.364506 Feb 10 03:39:40.762678 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 211/423] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:40 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:40.778255 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-33913ab0-25bb-4770-9341-59eca9e6c4ee tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:40.779910 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-33913ab0-25bb-4770-9341-59eca9e6c4ee tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:40.790688 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-33913ab0-25bb-4770-9341-59eca9e6c4ee tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.792637 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-33913ab0-25bb-4770-9341-59eca9e6c4ee tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.793948 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-33913ab0-25bb-4770-9341-59eca9e6c4ee tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:40.795077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-33913ab0-25bb-4770-9341-59eca9e6c4ee tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:40.833975 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-33913ab0-25bb-4770-9341-59eca9e6c4ee tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061654 Feb 10 03:39:40.838414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 213/424] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:39:40 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:41.136275 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3a15fa0d-f689-4f74-b5e7-914ccf3171c2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:41.136891 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3a15fa0d-f689-4f74-b5e7-914ccf3171c2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:41.137112 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:41.137710 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:41.147964 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.148426 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.149468 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.150141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3a15fa0d-f689-4f74-b5e7-914ccf3171c2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.150594 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3a15fa0d-f689-4f74-b5e7-914ccf3171c2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.151333 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.151896 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3a15fa0d-f689-4f74-b5e7-914ccf3171c2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.152502 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3a15fa0d-f689-4f74-b5e7-914ccf3171c2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.450539 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:41.455508 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3a15fa0d-f689-4f74-b5e7-914ccf3171c2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:41.460365 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:41.462044 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:41.463516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ef4511e7-69a8-4b3c-ad66-a287884c587a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.329805 Feb 10 03:39:41.464300 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 214/425] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:41 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:41.468842 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2b1290eb-fabe-4a86-9ed4-672ca5af4cc9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:41.469544 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2b1290eb-fabe-4a86-9ed4-672ca5af4cc9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:41.475687 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b1290eb-fabe-4a86-9ed4-672ca5af4cc9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.476406 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b1290eb-fabe-4a86-9ed4-672ca5af4cc9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.477421 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b1290eb-fabe-4a86-9ed4-672ca5af4cc9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.478066 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b1290eb-fabe-4a86-9ed4-672ca5af4cc9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.484468 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3a15fa0d-f689-4f74-b5e7-914ccf3171c2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.353996 Feb 10 03:39:41.492191 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 212/426] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:41 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:41.780179 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1f587b6e-d1c9-4eaa-84fb-fa851cf661a0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:41.781636 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1f587b6e-d1c9-4eaa-84fb-fa851cf661a0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:41.789220 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1f587b6e-d1c9-4eaa-84fb-fa851cf661a0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.790492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1f587b6e-d1c9-4eaa-84fb-fa851cf661a0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.791833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1f587b6e-d1c9-4eaa-84fb-fa851cf661a0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.793147 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1f587b6e-d1c9-4eaa-84fb-fa851cf661a0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.919776 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2b1290eb-fabe-4a86-9ed4-672ca5af4cc9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:41.932896 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2b1290eb-fabe-4a86-9ed4-672ca5af4cc9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.467150 Feb 10 03:39:41.934092 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 215/427] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:41 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:41.951573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-798ee9b8-5582-4591-b45b-891c0130ef66 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:41.951573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-798ee9b8-5582-4591-b45b-891c0130ef66 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:41.957590 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-798ee9b8-5582-4591-b45b-891c0130ef66 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.958040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-798ee9b8-5582-4591-b45b-891c0130ef66 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:41.958862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-798ee9b8-5582-4591-b45b-891c0130ef66 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:41.959344 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-798ee9b8-5582-4591-b45b-891c0130ef66 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:42.003288 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-798ee9b8-5582-4591-b45b-891c0130ef66 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067817 Feb 10 03:39:42.007293 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 216/428] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:39:41 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:42.027186 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1f587b6e-d1c9-4eaa-84fb-fa851cf661a0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:42.040619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1f587b6e-d1c9-4eaa-84fb-fa851cf661a0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.265765 Feb 10 03:39:42.041201 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 213/429] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:41 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:42.482226 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:42.483466 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:42.492406 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:42.493167 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:42.493995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:42.494613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:42.505442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2fdf676b-1048-480a-8c11-edddb4f94fad tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:42.506142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-2fdf676b-1048-480a-8c11-edddb4f94fad tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:42.512171 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2fdf676b-1048-480a-8c11-edddb4f94fad tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:42.512692 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2fdf676b-1048-480a-8c11-edddb4f94fad tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:42.513529 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2fdf676b-1048-480a-8c11-edddb4f94fad tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:42.514017 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2fdf676b-1048-480a-8c11-edddb4f94fad tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:42.712985 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:42.718069 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2fdf676b-1048-480a-8c11-edddb4f94fad tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:42.725184 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:42.725493 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2fdf676b-1048-480a-8c11-edddb4f94fad tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1266 microversion: 2.1 time: 0.223951 Feb 10 03:39:42.726082 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 214/430] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:42 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:42.726715 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:42.728157 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a79f7d1d-4564-44d7-a28b-a044d2df2ab9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1738 microversion: 2.20 time: 0.249789 Feb 10 03:39:42.728809 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 217/431] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:42 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:42.953171 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ac176fd7-cef0-4fac-852d-887365ee1dfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:42.953819 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ac176fd7-cef0-4fac-852d-887365ee1dfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:42.960570 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac176fd7-cef0-4fac-852d-887365ee1dfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:42.961219 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac176fd7-cef0-4fac-852d-887365ee1dfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:42.962022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac176fd7-cef0-4fac-852d-887365ee1dfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:42.963070 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac176fd7-cef0-4fac-852d-887365ee1dfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:43.016000 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-86b0c6b6-10bc-486a-848f-0ba67e637644 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:43.016921 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-86b0c6b6-10bc-486a-848f-0ba67e637644 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:43.023396 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-86b0c6b6-10bc-486a-848f-0ba67e637644 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:43.023872 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-86b0c6b6-10bc-486a-848f-0ba67e637644 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:43.024665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-86b0c6b6-10bc-486a-848f-0ba67e637644 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:43.025116 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-86b0c6b6-10bc-486a-848f-0ba67e637644 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:43.057052 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-86b0c6b6-10bc-486a-848f-0ba67e637644 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046463 Feb 10 03:39:43.057868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 218/432] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:39:43 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:39:43.073845 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-19b6edbd-9b00-4db4-893d-6f52d22e12df tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:43.074715 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-19b6edbd-9b00-4db4-893d-6f52d22e12df tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:43.081382 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-19b6edbd-9b00-4db4-893d-6f52d22e12df tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:43.082073 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-19b6edbd-9b00-4db4-893d-6f52d22e12df tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:43.083076 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-19b6edbd-9b00-4db4-893d-6f52d22e12df tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:43.083701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-19b6edbd-9b00-4db4-893d-6f52d22e12df tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:43.120144 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ac176fd7-cef0-4fac-852d-887365ee1dfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:43.133790 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ac176fd7-cef0-4fac-852d-887365ee1dfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.185448 Feb 10 03:39:43.134454 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 215/433] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:42 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:43.227396 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-19b6edbd-9b00-4db4-893d-6f52d22e12df tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:43.235089 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-19b6edbd-9b00-4db4-893d-6f52d22e12df tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.176085 Feb 10 03:39:43.235650 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 219/434] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:43 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:43.748704 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6341354b-ae6f-4554-b108-6e82f7802623 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:43.750358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:43.751329 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6341354b-ae6f-4554-b108-6e82f7802623 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:43.752168 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:43.765065 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6341354b-ae6f-4554-b108-6e82f7802623 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:43.765473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6341354b-ae6f-4554-b108-6e82f7802623 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:43.766263 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6341354b-ae6f-4554-b108-6e82f7802623 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:43.768432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:43.768826 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:43.769701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:43.770018 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:43.772984 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6341354b-ae6f-4554-b108-6e82f7802623 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.017756 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:44.021986 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6341354b-ae6f-4554-b108-6e82f7802623 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:44.026358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:44.027928 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:44.029129 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-db409577-95e1-48b1-9199-bd65c1d5c429 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1720 microversion: 2.20 time: 0.286470 Feb 10 03:39:44.029754 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 220/435] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:43 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:44.031563 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6341354b-ae6f-4554-b108-6e82f7802623 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1453 microversion: 2.1 time: 0.292566 Feb 10 03:39:44.032116 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 216/436] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:43 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1453 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:44.047037 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a5715471-29d4-4fd3-bae7-cc46aa392d4d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:44.047644 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a5715471-29d4-4fd3-bae7-cc46aa392d4d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:44.053826 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a5715471-29d4-4fd3-bae7-cc46aa392d4d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.054451 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a5715471-29d4-4fd3-bae7-cc46aa392d4d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.055292 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a5715471-29d4-4fd3-bae7-cc46aa392d4d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.055718 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a5715471-29d4-4fd3-bae7-cc46aa392d4d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.151258 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ce5cdda8-e6cc-4e17-be42-23bf2eab1d14 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:44.152044 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ce5cdda8-e6cc-4e17-be42-23bf2eab1d14 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:44.158722 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ce5cdda8-e6cc-4e17-be42-23bf2eab1d14 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.159172 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ce5cdda8-e6cc-4e17-be42-23bf2eab1d14 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.160007 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ce5cdda8-e6cc-4e17-be42-23bf2eab1d14 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.160379 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ce5cdda8-e6cc-4e17-be42-23bf2eab1d14 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.216425 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a5715471-29d4-4fd3-bae7-cc46aa392d4d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:44.224673 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a5715471-29d4-4fd3-bae7-cc46aa392d4d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1453 microversion: 2.1 time: 0.181144 Feb 10 03:39:44.225266 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 221/437] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:44 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:44.255071 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5291b966-8a47-47a9-919d-7203f270b658 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:44.255837 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5291b966-8a47-47a9-919d-7203f270b658 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:44.262693 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5291b966-8a47-47a9-919d-7203f270b658 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.266964 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5291b966-8a47-47a9-919d-7203f270b658 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.267843 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5291b966-8a47-47a9-919d-7203f270b658 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.268277 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5291b966-8a47-47a9-919d-7203f270b658 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.295203 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5291b966-8a47-47a9-919d-7203f270b658 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:39:44.314695 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ce5cdda8-e6cc-4e17-be42-23bf2eab1d14 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:44.324246 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ce5cdda8-e6cc-4e17-be42-23bf2eab1d14 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.176730 Feb 10 03:39:44.333997 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 217/438] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:44 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:44.338935 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d896787d-e619-4238-9d85-5f8a855bd490 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:44.339760 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d896787d-e619-4238-9d85-5f8a855bd490 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:44.345702 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d896787d-e619-4238-9d85-5f8a855bd490 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.346155 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d896787d-e619-4238-9d85-5f8a855bd490 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.347174 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d896787d-e619-4238-9d85-5f8a855bd490 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.347769 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d896787d-e619-4238-9d85-5f8a855bd490 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.382609 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5291b966-8a47-47a9-919d-7203f270b658 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 204 len: 0 microversion: 2.1 time: 0.130845 Feb 10 03:39:44.383412 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 222/439] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:39:44 2022] DELETE /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 10 03:39:44.392015 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e047fd57-6b8f-408a-93e9-e1b6307b70ec tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:44.392872 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e047fd57-6b8f-408a-93e9-e1b6307b70ec tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:44.400057 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e047fd57-6b8f-408a-93e9-e1b6307b70ec tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.400503 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e047fd57-6b8f-408a-93e9-e1b6307b70ec tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.401379 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e047fd57-6b8f-408a-93e9-e1b6307b70ec tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:44.401702 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e047fd57-6b8f-408a-93e9-e1b6307b70ec tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:44.521709 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d896787d-e619-4238-9d85-5f8a855bd490 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:44.535712 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d896787d-e619-4238-9d85-5f8a855bd490 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.200601 Feb 10 03:39:44.536536 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 218/440] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:44 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:44.580544 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e047fd57-6b8f-408a-93e9-e1b6307b70ec tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:44.587917 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e047fd57-6b8f-408a-93e9-e1b6307b70ec tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1512 microversion: 2.1 time: 0.199856 Feb 10 03:39:44.588481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 223/441] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:44 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:45.049030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:45.049030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:45.055969 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:45.056417 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:45.057173 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:45.057611 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:45.201411 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:45.211049 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:45.212887 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:45.217849 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-70acafdd-ccb8-4425-bf31-0e43364a9e29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1720 microversion: 2.20 time: 0.173503 Feb 10 03:39:45.227106 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 219/442] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:45 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:45.341177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0449e801-137b-439c-b3a3-54072aa330a0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:45.342024 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0449e801-137b-439c-b3a3-54072aa330a0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:45.348481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0449e801-137b-439c-b3a3-54072aa330a0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:45.348923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0449e801-137b-439c-b3a3-54072aa330a0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:45.349696 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0449e801-137b-439c-b3a3-54072aa330a0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:45.350123 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0449e801-137b-439c-b3a3-54072aa330a0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:45.497164 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0449e801-137b-439c-b3a3-54072aa330a0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:45.505825 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0449e801-137b-439c-b3a3-54072aa330a0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.168217 Feb 10 03:39:45.506695 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 224/443] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:45 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:45.552851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6977ded5-c759-4e64-aee6-6a53e02e1726 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:45.553536 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6977ded5-c759-4e64-aee6-6a53e02e1726 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:45.559946 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6977ded5-c759-4e64-aee6-6a53e02e1726 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:45.560968 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6977ded5-c759-4e64-aee6-6a53e02e1726 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:45.561797 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6977ded5-c759-4e64-aee6-6a53e02e1726 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:45.562222 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6977ded5-c759-4e64-aee6-6a53e02e1726 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:45.605685 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6df8416d-aeb4-4bea-93d4-0e5d6995d283 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:45.606331 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6df8416d-aeb4-4bea-93d4-0e5d6995d283 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:45.613416 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6df8416d-aeb4-4bea-93d4-0e5d6995d283 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:45.614175 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6df8416d-aeb4-4bea-93d4-0e5d6995d283 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:45.615298 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6df8416d-aeb4-4bea-93d4-0e5d6995d283 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:45.615963 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6df8416d-aeb4-4bea-93d4-0e5d6995d283 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:45.744835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6977ded5-c759-4e64-aee6-6a53e02e1726 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:45.753163 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6977ded5-c759-4e64-aee6-6a53e02e1726 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.204108 Feb 10 03:39:45.762326 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 220/444] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:45 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:45.810338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6df8416d-aeb4-4bea-93d4-0e5d6995d283 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:45.818493 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6df8416d-aeb4-4bea-93d4-0e5d6995d283 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1512 microversion: 2.1 time: 0.217334 Feb 10 03:39:45.819251 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 225/445] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:45 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:46.236743 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:46.237306 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:46.244343 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.244776 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:46.245941 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.246379 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:46.388054 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-09e1851a-c513-4661-b5f8-bf1b1e01b389 req-923e9b15-5edc-4cc5-999b-39db622d0c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6526425c-4ed8-4fc2-982e-cfa3c75087c3", "tag": "336de512-11fe-4594-b1b4-1b948f7eceab"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:46.390339 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:46.390339 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:39:46.400466 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-09e1851a-c513-4661-b5f8-bf1b1e01b389 req-923e9b15-5edc-4cc5-999b-39db622d0c04 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.401602 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-09e1851a-c513-4661-b5f8-bf1b1e01b389 req-923e9b15-5edc-4cc5-999b-39db622d0c04 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:46.416791 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-09e1851a-c513-4661-b5f8-bf1b1e01b389 req-923e9b15-5edc-4cc5-999b-39db622d0c04 service nova] Creating event network-changed:336de512-11fe-4594-b1b4-1b948f7eceab for instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 on hv-cinder-82806 Feb 10 03:39:46.423984 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-09e1851a-c513-4661-b5f8-bf1b1e01b389 req-923e9b15-5edc-4cc5-999b-39db622d0c04 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039359 Feb 10 03:39:46.424883 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 226/446] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:39:46.438976 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:46.447541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:46.449087 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:46.450445 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2e0c134d-a052-45ab-8251-15a94e6e3ac3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1720 microversion: 2.20 time: 0.218107 Feb 10 03:39:46.451541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 221/447] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:46 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:46.525415 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-22ce6740-75ca-48e4-b8c6-50f4426844da tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:46.526205 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-22ce6740-75ca-48e4-b8c6-50f4426844da tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:46.532544 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-22ce6740-75ca-48e4-b8c6-50f4426844da tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.533110 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-22ce6740-75ca-48e4-b8c6-50f4426844da tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:46.533950 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-22ce6740-75ca-48e4-b8c6-50f4426844da tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.534453 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-22ce6740-75ca-48e4-b8c6-50f4426844da tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:46.722871 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-22ce6740-75ca-48e4-b8c6-50f4426844da tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:46.735722 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-22ce6740-75ca-48e4-b8c6-50f4426844da tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1722 microversion: 2.1 time: 0.213945 Feb 10 03:39:46.736920 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 227/448] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:46 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:46.770840 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-73cb2e34-3f77-4e62-943b-6686b91aabf2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:46.771351 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-73cb2e34-3f77-4e62-943b-6686b91aabf2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:46.780486 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-73cb2e34-3f77-4e62-943b-6686b91aabf2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.781138 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-73cb2e34-3f77-4e62-943b-6686b91aabf2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:46.781938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-73cb2e34-3f77-4e62-943b-6686b91aabf2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.782561 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-73cb2e34-3f77-4e62-943b-6686b91aabf2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:46.836318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-9e9486bd-122e-41c8-9152-5b1bc926c702 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:46.837232 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9e9486bd-122e-41c8-9152-5b1bc926c702 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:46.844180 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9e9486bd-122e-41c8-9152-5b1bc926c702 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.844643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9e9486bd-122e-41c8-9152-5b1bc926c702 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:46.845432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9e9486bd-122e-41c8-9152-5b1bc926c702 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:46.845860 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9e9486bd-122e-41c8-9152-5b1bc926c702 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:47.036135 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-73cb2e34-3f77-4e62-943b-6686b91aabf2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:47.043818 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-73cb2e34-3f77-4e62-943b-6686b91aabf2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.277462 Feb 10 03:39:47.045186 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 222/449] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:46 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:47.078053 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-9e9486bd-122e-41c8-9152-5b1bc926c702 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:47.085321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-9e9486bd-122e-41c8-9152-5b1bc926c702 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1512 microversion: 2.1 time: 0.253556 Feb 10 03:39:47.085888 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 228/450] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:46 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:47.470155 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:47.471669 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:47.482153 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:47.483016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:47.484174 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:47.484612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:47.725640 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-3c6d2bd2-26c0-47d5-b3ec-1d3baef90e03 req-db2e5794-562c-4747-bb30-951829713b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2d5f1-131a-4713-9d41-f99e7b3897c7", "name": "network-vif-deleted", "tag": "b590bb01-bf48-4666-8123-155cb2cc0ab8"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:47.727309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:47.727309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:39:47.750488 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-3c6d2bd2-26c0-47d5-b3ec-1d3baef90e03 req-db2e5794-562c-4747-bb30-951829713b9e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:47.750962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-3c6d2bd2-26c0-47d5-b3ec-1d3baef90e03 req-db2e5794-562c-4747-bb30-951829713b9e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:47.753476 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:47.775587 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-3c6d2bd2-26c0-47d5-b3ec-1d3baef90e03 req-db2e5794-562c-4747-bb30-951829713b9e service nova] Creating event network-vif-deleted:b590bb01-bf48-4666-8123-155cb2cc0ab8 for instance 49b2d5f1-131a-4713-9d41-f99e7b3897c7 on hv-cinder-82806 Feb 10 03:39:47.784610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-3c6d2bd2-26c0-47d5-b3ec-1d3baef90e03 req-db2e5794-562c-4747-bb30-951829713b9e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062901 Feb 10 03:39:47.785748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 229/451] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:39:47.789647 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:47.791523 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:47.792810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-52aa6b31-7781-45a4-a9c1-ce1468c06dac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1663 microversion: 2.20 time: 0.327599 Feb 10 03:39:47.793916 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 223/452] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:47 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1663 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:47.799972 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-cc6cd278-6b62-4f54-8604-89d2c62ad702 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:47.801048 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-cc6cd278-6b62-4f54-8604-89d2c62ad702 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:47.810233 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cc6cd278-6b62-4f54-8604-89d2c62ad702 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:47.811385 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cc6cd278-6b62-4f54-8604-89d2c62ad702 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:47.812203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f2d31a62-b616-4f99-8cf2-4dc19061c924 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b61308dd-920e-444f-b40a-2b707c8d1691"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:47.812733 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cc6cd278-6b62-4f54-8604-89d2c62ad702 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:47.813432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cc6cd278-6b62-4f54-8604-89d2c62ad702 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:47.813725 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f2d31a62-b616-4f99-8cf2-4dc19061c924 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:47.833104 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2d31a62-b616-4f99-8cf2-4dc19061c924 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:47.833818 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2d31a62-b616-4f99-8cf2-4dc19061c924 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:47.834851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2d31a62-b616-4f99-8cf2-4dc19061c924 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:47.835290 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2d31a62-b616-4f99-8cf2-4dc19061c924 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.043868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-cc6cd278-6b62-4f54-8604-89d2c62ad702 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:48.052767 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-cc6cd278-6b62-4f54-8604-89d2c62ad702 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1699 microversion: 2.1 time: 0.265288 Feb 10 03:39:48.053330 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 230/453] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:47 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1699 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:48.057722 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-288e8c03-9d1e-45ef-8009-6e4efaa774b1 req-8d17cfd3-c37f-41a8-82cd-2392db616aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d302b3d4-6282-4fbe-a4c4-248881ee8f51", "name": "network-vif-unplugged", "status": "completed", "tag": "29a0a5b3-6729-4753-8ce5-55f51a8c9a2e"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:48.059271 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:39:48.059271 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:39:48.071696 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-288e8c03-9d1e-45ef-8009-6e4efaa774b1 req-8d17cfd3-c37f-41a8-82cd-2392db616aa8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.072444 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-288e8c03-9d1e-45ef-8009-6e4efaa774b1 req-8d17cfd3-c37f-41a8-82cd-2392db616aa8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.086217 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.compute.server_external_events [req-288e8c03-9d1e-45ef-8009-6e4efaa774b1 req-8d17cfd3-c37f-41a8-82cd-2392db616aa8 service nova] Unable to find a host for instance d302b3d4-6282-4fbe-a4c4-248881ee8f51. Dropping event network-vif-unplugged {{(pid=127952) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 10 03:39:48.087020 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-288e8c03-9d1e-45ef-8009-6e4efaa774b1 req-8d17cfd3-c37f-41a8-82cd-2392db616aa8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032765 Feb 10 03:39:48.087908 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 231/454] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 10 03:39:48.092465 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b166d9db-f4e5-44f7-9543-2ba98cc8139f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:48.093130 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b166d9db-f4e5-44f7-9543-2ba98cc8139f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:48.101034 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b166d9db-f4e5-44f7-9543-2ba98cc8139f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.101537 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b166d9db-f4e5-44f7-9543-2ba98cc8139f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.102322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b166d9db-f4e5-44f7-9543-2ba98cc8139f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.102944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b166d9db-f4e5-44f7-9543-2ba98cc8139f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.188122 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f2d31a62-b616-4f99-8cf2-4dc19061c924 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.380753 Feb 10 03:39:48.189125 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 224/455] 10.222.0.32 () {62 vars in 1363 bytes} [Thu Feb 10 03:39:47 2022] POST /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments => generated 188 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:39:48.194641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ac3c2a8c-3719-4839-bbb1-bfa98b9f886b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:48.202233 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac3c2a8c-3719-4839-bbb1-bfa98b9f886b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.202858 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac3c2a8c-3719-4839-bbb1-bfa98b9f886b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.229928 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ac3c2a8c-3719-4839-bbb1-bfa98b9f886b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Going to try to start instance {{(pid=127951) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 10 03:39:48.281356 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b166d9db-f4e5-44f7-9543-2ba98cc8139f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:48.293395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b166d9db-f4e5-44f7-9543-2ba98cc8139f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.203415 Feb 10 03:39:48.294089 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 232/456] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:48 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:48.308962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:48.310910 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:48.313189 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ac3c2a8c-3719-4839-bbb1-bfa98b9f886b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/action" status: 202 len: 0 microversion: 2.1 time: 0.121558 Feb 10 03:39:48.315006 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 225/457] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:39:48 2022] POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:39:48.323200 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.325635 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-76bc99e3-f6e2-4a82-90b8-0def2ea8eff5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:48.326346 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-76bc99e3-f6e2-4a82-90b8-0def2ea8eff5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:48.329006 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.330263 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.330887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.338172 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76bc99e3-f6e2-4a82-90b8-0def2ea8eff5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.338552 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76bc99e3-f6e2-4a82-90b8-0def2ea8eff5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.339386 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76bc99e3-f6e2-4a82-90b8-0def2ea8eff5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.339854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76bc99e3-f6e2-4a82-90b8-0def2ea8eff5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.380731 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.381372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.381824 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lazy-loading 'fault' on Instance uuid 49b2d5f1-131a-4713-9d41-f99e7b3897c7 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:39:48.424471 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:48.437338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8f55d772-cb20-4263-8289-4f5b4c01a02b tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 200 len: 1307 microversion: 2.1 time: 0.132097 Feb 10 03:39:48.437925 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 233/458] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:48 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:48.442448 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5b39840c-d0a1-4ac5-8e5e-f597a877b8bb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:48.443081 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5b39840c-d0a1-4ac5-8e5e-f597a877b8bb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:48.449110 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b39840c-d0a1-4ac5-8e5e-f597a877b8bb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.449582 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b39840c-d0a1-4ac5-8e5e-f597a877b8bb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.450432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b39840c-d0a1-4ac5-8e5e-f597a877b8bb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.450985 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b39840c-d0a1-4ac5-8e5e-f597a877b8bb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.477546 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-76bc99e3-f6e2-4a82-90b8-0def2ea8eff5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/action" status: 202 len: 0 microversion: 2.20 time: 0.161288 Feb 10 03:39:48.478159 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 226/459] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Feb 10 03:39:48 2022] POST /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:39:48.485929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:48.486821 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:48.496089 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.496714 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.501344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:48.502591 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:48.764839 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5b39840c-d0a1-4ac5-8e5e-f597a877b8bb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:48.773942 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5b39840c-d0a1-4ac5-8e5e-f597a877b8bb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1708 microversion: 2.1 time: 0.334987 Feb 10 03:39:48.774596 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 234/460] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:48 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1708 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:48.789848 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:48.798851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:48.801130 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:48.802317 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-efb4da64-a7ea-4b70-bf91-312ee07ed21b tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1749 microversion: 2.20 time: 0.320049 Feb 10 03:39:48.802891 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 227/461] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:48 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1749 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:49.311830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-851856ba-dce8-4ade-bdef-79539c74107e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:49.312437 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-851856ba-dce8-4ade-bdef-79539c74107e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:49.319030 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-851856ba-dce8-4ade-bdef-79539c74107e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:49.319624 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-851856ba-dce8-4ade-bdef-79539c74107e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:49.320477 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-851856ba-dce8-4ade-bdef-79539c74107e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:49.320962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-851856ba-dce8-4ade-bdef-79539c74107e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:49.455345 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:49.456332 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 49b2d5f1-131a-4713-9d41-f99e7b3897c7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:49.466196 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:49.466677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:49.467551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:49.468077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-851856ba-dce8-4ade-bdef-79539c74107e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:49.470543 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:49.479508 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-851856ba-dce8-4ade-bdef-79539c74107e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.172426 Feb 10 03:39:49.480126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 235/462] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:49 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:49.485301 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] HTTP exception thrown: Instance 49b2d5f1-131a-4713-9d41-f99e7b3897c7 could not be found. Feb 10 03:39:49.485861 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Returning 404 to user: Instance 49b2d5f1-131a-4713-9d41-f99e7b3897c7 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:39:49.486884 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-923c5bf2-38ca-4770-98d0-d96d9c364831 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7" status: 404 len: 111 microversion: 2.1 time: 0.036902 Feb 10 03:39:49.487574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 228/463] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:49 2022] GET /compute/v2.1/servers/49b2d5f1-131a-4713-9d41-f99e7b3897c7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:39:49.791641 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c49d4868-defa-45f6-842c-4c23867340a2 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:49.792245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c49d4868-defa-45f6-842c-4c23867340a2 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:49.799374 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c49d4868-defa-45f6-842c-4c23867340a2 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:49.799813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c49d4868-defa-45f6-842c-4c23867340a2 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:49.800601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c49d4868-defa-45f6-842c-4c23867340a2 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:49.801034 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c49d4868-defa-45f6-842c-4c23867340a2 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:49.819981 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:49.820598 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:49.826397 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:49.826877 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:49.827638 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:49.828062 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:50.007822 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c49d4868-defa-45f6-842c-4c23867340a2 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:50.015807 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c49d4868-defa-45f6-842c-4c23867340a2 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1708 microversion: 2.1 time: 0.227906 Feb 10 03:39:50.016740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 236/464] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:49 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1708 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:50.019439 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:50.028360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:50.029983 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:50.031161 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7873ea55-d332-48cc-9db1-c7eeb00346d9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1751 microversion: 2.20 time: 0.215091 Feb 10 03:39:50.031703 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 229/465] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:49 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:50.500973 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-47eb661a-885f-49cc-bd7e-1edea85a699c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:50.501804 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-47eb661a-885f-49cc-bd7e-1edea85a699c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:50.512148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-47eb661a-885f-49cc-bd7e-1edea85a699c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:50.512898 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-47eb661a-885f-49cc-bd7e-1edea85a699c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:50.514100 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-47eb661a-885f-49cc-bd7e-1edea85a699c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:50.514542 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-47eb661a-885f-49cc-bd7e-1edea85a699c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:50.665003 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-47eb661a-885f-49cc-bd7e-1edea85a699c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:50.674063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-47eb661a-885f-49cc-bd7e-1edea85a699c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.179820 Feb 10 03:39:50.674630 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 237/466] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:50 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:51.035432 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-5b086a65-da32-46c5-926a-931178c35ce0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:51.036430 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-5b086a65-da32-46c5-926a-931178c35ce0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:51.046103 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5b086a65-da32-46c5-926a-931178c35ce0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:51.046534 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5b086a65-da32-46c5-926a-931178c35ce0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:51.047363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5b086a65-da32-46c5-926a-931178c35ce0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:51.047799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5b086a65-da32-46c5-926a-931178c35ce0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:51.055694 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:51.056288 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:51.062955 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:51.063499 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:51.064313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:51.064749 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:51.253386 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-5b086a65-da32-46c5-926a-931178c35ce0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:51.257410 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:51.261359 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-5b086a65-da32-46c5-926a-931178c35ce0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1708 microversion: 2.1 time: 0.232014 Feb 10 03:39:51.261919 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 230/467] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:51 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1708 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:51.266079 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:51.267612 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:51.268764 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-90d299d7-a9fe-4283-8928-5e952814489d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1751 microversion: 2.20 time: 0.216790 Feb 10 03:39:51.269346 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 238/468] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:51 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1751 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:51.691047 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c8a75c2e-ceef-47db-8c22-c28dec496698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:51.691650 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c8a75c2e-ceef-47db-8c22-c28dec496698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:51.697957 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c8a75c2e-ceef-47db-8c22-c28dec496698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:51.698406 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c8a75c2e-ceef-47db-8c22-c28dec496698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:51.699218 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c8a75c2e-ceef-47db-8c22-c28dec496698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:51.699647 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c8a75c2e-ceef-47db-8c22-c28dec496698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:51.840441 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c8a75c2e-ceef-47db-8c22-c28dec496698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:51.848114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c8a75c2e-ceef-47db-8c22-c28dec496698 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.160787 Feb 10 03:39:51.848677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 231/469] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:51 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:52.278454 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-83ad5cec-b8ad-4d5e-96da-151a9a799df6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:52.279033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-83ad5cec-b8ad-4d5e-96da-151a9a799df6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:52.286868 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:52.287392 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-83ad5cec-b8ad-4d5e-96da-151a9a799df6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:52.287560 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:52.287787 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-83ad5cec-b8ad-4d5e-96da-151a9a799df6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:52.288505 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-83ad5cec-b8ad-4d5e-96da-151a9a799df6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:52.288945 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-83ad5cec-b8ad-4d5e-96da-151a9a799df6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:52.294205 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:52.294664 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:52.295492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:52.295925 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:52.497860 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-83ad5cec-b8ad-4d5e-96da-151a9a799df6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:52.501808 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:52.505934 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-83ad5cec-b8ad-4d5e-96da-151a9a799df6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1708 microversion: 2.1 time: 0.231201 Feb 10 03:39:52.506516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 239/470] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:52 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1708 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:52.510229 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:52.511873 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:52.513081 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-92c527f6-194a-475d-8244-40c7b122a033 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1751 microversion: 2.20 time: 0.230021 Feb 10 03:39:52.513617 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 232/471] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:52 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:52.865137 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-bba79fcb-4b48-4c5c-9132-fa9668dc2e42 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:52.865732 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-bba79fcb-4b48-4c5c-9132-fa9668dc2e42 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:52.872480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bba79fcb-4b48-4c5c-9132-fa9668dc2e42 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:52.872922 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bba79fcb-4b48-4c5c-9132-fa9668dc2e42 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:52.873788 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bba79fcb-4b48-4c5c-9132-fa9668dc2e42 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:52.874225 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bba79fcb-4b48-4c5c-9132-fa9668dc2e42 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:53.020663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-bba79fcb-4b48-4c5c-9132-fa9668dc2e42 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:53.028762 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-bba79fcb-4b48-4c5c-9132-fa9668dc2e42 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.167378 Feb 10 03:39:53.029344 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 240/472] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:52 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:53.523381 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9fa0abd0-0096-413c-a53d-cb3110b864dd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:53.523945 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9fa0abd0-0096-413c-a53d-cb3110b864dd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:53.530865 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9fa0abd0-0096-413c-a53d-cb3110b864dd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:53.531318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9fa0abd0-0096-413c-a53d-cb3110b864dd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:53.532242 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9fa0abd0-0096-413c-a53d-cb3110b864dd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:53.532677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9fa0abd0-0096-413c-a53d-cb3110b864dd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:53.534919 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:53.535676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:53.542347 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:53.542821 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:53.543618 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:53.544033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:53.743692 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-9fa0abd0-0096-413c-a53d-cb3110b864dd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:53.752061 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9fa0abd0-0096-413c-a53d-cb3110b864dd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1712 microversion: 2.1 time: 0.232347 Feb 10 03:39:53.753020 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 233/473] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:53 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1712 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:53.774727 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:53.776381 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1d2efc76-352d-458b-bb7c-b6325535b080 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:53.776999 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1d2efc76-352d-458b-bb7c-b6325535b080 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:53.783314 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1d2efc76-352d-458b-bb7c-b6325535b080 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:53.783799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1d2efc76-352d-458b-bb7c-b6325535b080 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:53.783944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:53.784659 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1d2efc76-352d-458b-bb7c-b6325535b080 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:53.785091 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1d2efc76-352d-458b-bb7c-b6325535b080 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:53.785475 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:53.786643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-27a575d9-3f07-49b5-b1fb-0124f6e8420d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1751 microversion: 2.20 time: 0.255492 Feb 10 03:39:53.787254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 241/474] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:53 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1751 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:53.813950 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1d2efc76-352d-458b-bb7c-b6325535b080 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Going to try to terminate instance {{(pid=127951) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:39:53.907802 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1d2efc76-352d-458b-bb7c-b6325535b080 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 204 len: 0 microversion: 2.1 time: 0.135139 Feb 10 03:39:53.908497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 234/475] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:39:53 2022] DELETE /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 10 03:39:53.916906 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2805ddf3-8979-4b0b-8188-deb4ed5ba240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:53.917511 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2805ddf3-8979-4b0b-8188-deb4ed5ba240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:53.924062 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2805ddf3-8979-4b0b-8188-deb4ed5ba240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:53.924506 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2805ddf3-8979-4b0b-8188-deb4ed5ba240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:53.925282 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2805ddf3-8979-4b0b-8188-deb4ed5ba240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:53.925711 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2805ddf3-8979-4b0b-8188-deb4ed5ba240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:54.046458 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bb5c1801-85b3-4934-a0bc-c3ac6d67d718 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:54.047092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bb5c1801-85b3-4934-a0bc-c3ac6d67d718 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:54.053496 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bb5c1801-85b3-4934-a0bc-c3ac6d67d718 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:54.054352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bb5c1801-85b3-4934-a0bc-c3ac6d67d718 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:54.054825 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bb5c1801-85b3-4934-a0bc-c3ac6d67d718 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:54.055173 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bb5c1801-85b3-4934-a0bc-c3ac6d67d718 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:54.071574 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2805ddf3-8979-4b0b-8188-deb4ed5ba240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:54.080354 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2805ddf3-8979-4b0b-8188-deb4ed5ba240 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.167252 Feb 10 03:39:54.080939 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 242/476] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:53 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:54.203853 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bb5c1801-85b3-4934-a0bc-c3ac6d67d718 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:54.211567 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bb5c1801-85b3-4934-a0bc-c3ac6d67d718 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.169757 Feb 10 03:39:54.212136 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 235/477] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:54 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:54.806687 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:54.806687 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:54.821026 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:54.821470 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:54.822334 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:54.822865 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:55.019645 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:55.028415 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:55.029944 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:55.031173 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-29f65906-c5cb-49e9-984f-0c0ca734dab2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.229492 Feb 10 03:39:55.031776 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 243/478] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:54 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:55.097576 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b6adaf5f-338e-4155-afcd-bbdc8a1a44eb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:55.098201 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b6adaf5f-338e-4155-afcd-bbdc8a1a44eb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:55.105049 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6adaf5f-338e-4155-afcd-bbdc8a1a44eb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:55.105483 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6adaf5f-338e-4155-afcd-bbdc8a1a44eb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:55.106265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6adaf5f-338e-4155-afcd-bbdc8a1a44eb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:55.106696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6adaf5f-338e-4155-afcd-bbdc8a1a44eb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:55.228212 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6f9697a4-7054-474a-b20b-4734d569ee6a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:55.228813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6f9697a4-7054-474a-b20b-4734d569ee6a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:55.235082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f9697a4-7054-474a-b20b-4734d569ee6a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:55.235652 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f9697a4-7054-474a-b20b-4734d569ee6a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:55.236443 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f9697a4-7054-474a-b20b-4734d569ee6a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:55.236888 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f9697a4-7054-474a-b20b-4734d569ee6a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:55.632188 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b6adaf5f-338e-4155-afcd-bbdc8a1a44eb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:55.640411 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b6adaf5f-338e-4155-afcd-bbdc8a1a44eb tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.546536 Feb 10 03:39:55.641014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 236/479] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:55 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:55.695126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6f9697a4-7054-474a-b20b-4734d569ee6a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:55.702958 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6f9697a4-7054-474a-b20b-4734d569ee6a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1521 microversion: 2.1 time: 0.478404 Feb 10 03:39:55.703512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 244/480] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:55 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:56.049704 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:56.050309 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:56.056240 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:56.056726 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:56.057439 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:56.057865 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:56.194102 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:56.202972 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:56.204473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:56.205633 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dba651d3-8408-4360-9681-28b2be349237 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.159844 Feb 10 03:39:56.206170 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 237/481] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:56 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:56.657182 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-be073821-0023-4976-b706-369166c41c5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:56.657940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-be073821-0023-4976-b706-369166c41c5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:56.664447 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-be073821-0023-4976-b706-369166c41c5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:56.664862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-be073821-0023-4976-b706-369166c41c5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:56.665845 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-be073821-0023-4976-b706-369166c41c5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:56.666285 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-be073821-0023-4976-b706-369166c41c5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:56.719860 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2284a2b2-c46c-441a-8e0d-67f7f7407a60 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:56.720734 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-2284a2b2-c46c-441a-8e0d-67f7f7407a60 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:56.727130 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2284a2b2-c46c-441a-8e0d-67f7f7407a60 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:56.727571 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2284a2b2-c46c-441a-8e0d-67f7f7407a60 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:56.728357 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2284a2b2-c46c-441a-8e0d-67f7f7407a60 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:56.728808 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2284a2b2-c46c-441a-8e0d-67f7f7407a60 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:56.848491 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-be073821-0023-4976-b706-369166c41c5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:56.857880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-be073821-0023-4976-b706-369166c41c5e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.204300 Feb 10 03:39:56.859427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 245/482] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:56 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:56.928432 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2284a2b2-c46c-441a-8e0d-67f7f7407a60 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:56.937100 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2284a2b2-c46c-441a-8e0d-67f7f7407a60 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1501 microversion: 2.1 time: 0.221028 Feb 10 03:39:56.938345 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 238/483] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:56 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:56.956948 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a7030746-4111-4627-af8f-38cd528eec16 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:56.957654 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a7030746-4111-4627-af8f-38cd528eec16 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:56.963929 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a7030746-4111-4627-af8f-38cd528eec16 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:56.964372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a7030746-4111-4627-af8f-38cd528eec16 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:56.965149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a7030746-4111-4627-af8f-38cd528eec16 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:56.965575 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a7030746-4111-4627-af8f-38cd528eec16 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:57.136783 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a7030746-4111-4627-af8f-38cd528eec16 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:57.145617 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a7030746-4111-4627-af8f-38cd528eec16 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1515 microversion: 2.1 time: 0.193575 Feb 10 03:39:57.147164 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 246/484] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:56 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:57.224298 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:57.224901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:57.242364 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:57.243092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:57.244070 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:57.244647 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:57.404067 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:57.414243 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:57.415962 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:57.417346 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6d5b499e-40cb-4414-bfc1-18d371cb2523 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.196898 Feb 10 03:39:57.428907 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 239/485] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:57 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:39:57.876236 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-fa9b010f-b3e1-4c84-b9bb-12827c93f0a2 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:57.877511 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-fa9b010f-b3e1-4c84-b9bb-12827c93f0a2 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:57.883786 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fa9b010f-b3e1-4c84-b9bb-12827c93f0a2 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:57.884228 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fa9b010f-b3e1-4c84-b9bb-12827c93f0a2 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:57.884983 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fa9b010f-b3e1-4c84-b9bb-12827c93f0a2 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:57.885412 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fa9b010f-b3e1-4c84-b9bb-12827c93f0a2 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:58.032227 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-fa9b010f-b3e1-4c84-b9bb-12827c93f0a2 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:58.040280 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-fa9b010f-b3e1-4c84-b9bb-12827c93f0a2 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.167965 Feb 10 03:39:58.040862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 247/486] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:57 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:58.437590 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:58.438331 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:58.445277 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:58.445719 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:58.446503 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:58.446964 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:58.622814 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:58.631750 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:58.633462 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:58.634457 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-29e21cf0-79c4-407a-a03a-52a0bda60d05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.201678 Feb 10 03:39:58.646071 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 240/487] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:58 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:39:58.699382 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-be381075-3806-4139-b67d-3c943d6ce57c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:39:58.700862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-be381075-3806-4139-b67d-3c943d6ce57c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:58.707538 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-be381075-3806-4139-b67d-3c943d6ce57c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:58.708273 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-be381075-3806-4139-b67d-3c943d6ce57c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:58.709045 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-be381075-3806-4139-b67d-3c943d6ce57c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:58.709487 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-be381075-3806-4139-b67d-3c943d6ce57c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:58.741225 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-be381075-3806-4139-b67d-3c943d6ce57c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lazy-loading 'flavor' on Instance uuid 699b7ed3-80f5-47d0-bcec-6801073102d6 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:39:58.828816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-be381075-3806-4139-b67d-3c943d6ce57c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/action" status: 200 len: 32 microversion: 2.1 time: 0.134345 Feb 10 03:39:58.829425 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 248/488] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:39:58 2022] POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/action => generated 32 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:39:58.838798 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c821fb66-3f24-40fe-b994-05a9ef8ff005 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:58.839433 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c821fb66-3f24-40fe-b994-05a9ef8ff005 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:58.845719 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c821fb66-3f24-40fe-b994-05a9ef8ff005 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:58.846166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c821fb66-3f24-40fe-b994-05a9ef8ff005 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:58.847001 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c821fb66-3f24-40fe-b994-05a9ef8ff005 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:58.847433 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c821fb66-3f24-40fe-b994-05a9ef8ff005 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:58.986523 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c821fb66-3f24-40fe-b994-05a9ef8ff005 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:58.994326 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c821fb66-3f24-40fe-b994-05a9ef8ff005 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.159706 Feb 10 03:39:58.994864 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 241/489] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:58 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:39:59.058076 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2668bf02-6afa-484a-9e40-fde9cdb5cf2a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:59.059024 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2668bf02-6afa-484a-9e40-fde9cdb5cf2a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:59.068010 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2668bf02-6afa-484a-9e40-fde9cdb5cf2a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:59.068455 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2668bf02-6afa-484a-9e40-fde9cdb5cf2a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:59.069390 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2668bf02-6afa-484a-9e40-fde9cdb5cf2a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:59.069817 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2668bf02-6afa-484a-9e40-fde9cdb5cf2a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:59.266452 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2668bf02-6afa-484a-9e40-fde9cdb5cf2a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:59.274000 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2668bf02-6afa-484a-9e40-fde9cdb5cf2a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.220436 Feb 10 03:39:59.274553 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 249/490] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:39:59 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:39:59.653214 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:39:59.653885 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:39:59.660522 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:59.660973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:59.661762 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:39:59.662197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:39:59.834863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:59.843203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:59.844666 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:39:59.845809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dea34c1c-dc96-4b62-aa20-7d67c7436cc9 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.196480 Feb 10 03:39:59.846368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 242/491] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:39:59 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:00.011965 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0e4a4dc9-4b24-42bf-98d9-0b756d646bfb tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:00.012576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0e4a4dc9-4b24-42bf-98d9-0b756d646bfb tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:00.018869 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0e4a4dc9-4b24-42bf-98d9-0b756d646bfb tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:00.019338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0e4a4dc9-4b24-42bf-98d9-0b756d646bfb tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:00.020130 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0e4a4dc9-4b24-42bf-98d9-0b756d646bfb tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:00.020572 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0e4a4dc9-4b24-42bf-98d9-0b756d646bfb tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:00.169414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0e4a4dc9-4b24-42bf-98d9-0b756d646bfb tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:00.177834 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0e4a4dc9-4b24-42bf-98d9-0b756d646bfb tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.170244 Feb 10 03:40:00.187511 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 250/492] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:00 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:00.291638 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-28e6ec5d-39f8-4a7e-8bdb-4c691e658af3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:00.292324 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-28e6ec5d-39f8-4a7e-8bdb-4c691e658af3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:00.299061 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-28e6ec5d-39f8-4a7e-8bdb-4c691e658af3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:00.299506 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-28e6ec5d-39f8-4a7e-8bdb-4c691e658af3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:00.300294 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-28e6ec5d-39f8-4a7e-8bdb-4c691e658af3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:00.300724 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-28e6ec5d-39f8-4a7e-8bdb-4c691e658af3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:00.462867 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-28e6ec5d-39f8-4a7e-8bdb-4c691e658af3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:00.470278 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-28e6ec5d-39f8-4a7e-8bdb-4c691e658af3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.182585 Feb 10 03:40:00.470875 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 243/493] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:00 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:00.864216 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:00.864822 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:00.871194 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:00.871643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:00.872425 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:00.872895 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:01.009551 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:01.018691 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:01.020864 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:01.025666 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ff8b2dda-cbed-4c16-9684-1bcfd6dec676 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.165136 Feb 10 03:40:01.027084 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 251/494] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:00 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:01.195419 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-374d7375-8e8b-4b71-9404-fa36acbe0bf1 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:01.196084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-374d7375-8e8b-4b71-9404-fa36acbe0bf1 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:01.202988 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-374d7375-8e8b-4b71-9404-fa36acbe0bf1 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:01.203437 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-374d7375-8e8b-4b71-9404-fa36acbe0bf1 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:01.204205 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-374d7375-8e8b-4b71-9404-fa36acbe0bf1 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:01.204637 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-374d7375-8e8b-4b71-9404-fa36acbe0bf1 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:01.346223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-374d7375-8e8b-4b71-9404-fa36acbe0bf1 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:01.354093 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-374d7375-8e8b-4b71-9404-fa36acbe0bf1 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.162428 Feb 10 03:40:01.354681 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 244/495] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:01 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:01.488081 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-660bf9e0-8199-45d1-88b3-f751954d4a5f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:01.488709 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-660bf9e0-8199-45d1-88b3-f751954d4a5f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:01.496277 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-660bf9e0-8199-45d1-88b3-f751954d4a5f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:01.496746 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-660bf9e0-8199-45d1-88b3-f751954d4a5f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:01.497541 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-660bf9e0-8199-45d1-88b3-f751954d4a5f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:01.497961 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-660bf9e0-8199-45d1-88b3-f751954d4a5f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:01.649179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-660bf9e0-8199-45d1-88b3-f751954d4a5f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:01.657407 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-660bf9e0-8199-45d1-88b3-f751954d4a5f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.172953 Feb 10 03:40:01.658337 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 252/496] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:01 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:02.044749 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:02.045387 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:02.051940 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:02.052393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:02.053174 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:02.053610 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:02.206472 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:02.215297 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:02.217049 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:02.218279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-34c66192-6649-4a7d-bd2a-70b357fbeb0e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.177464 Feb 10 03:40:02.218930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 245/497] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:02 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:02.371341 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-deb70113-08a7-4c5f-812c-55e68a2b49dc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:02.371937 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-deb70113-08a7-4c5f-812c-55e68a2b49dc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:02.378191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-deb70113-08a7-4c5f-812c-55e68a2b49dc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:02.378631 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-deb70113-08a7-4c5f-812c-55e68a2b49dc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:02.379426 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-deb70113-08a7-4c5f-812c-55e68a2b49dc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:02.379852 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-deb70113-08a7-4c5f-812c-55e68a2b49dc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:02.528482 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-deb70113-08a7-4c5f-812c-55e68a2b49dc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:02.536137 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-deb70113-08a7-4c5f-812c-55e68a2b49dc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.168738 Feb 10 03:40:02.536716 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 253/498] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:02 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:02.680979 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d19b1b87-8d64-4add-89c5-6b4361611273 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:02.681822 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d19b1b87-8d64-4add-89c5-6b4361611273 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:02.693564 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d19b1b87-8d64-4add-89c5-6b4361611273 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:02.694010 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d19b1b87-8d64-4add-89c5-6b4361611273 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:02.694835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d19b1b87-8d64-4add-89c5-6b4361611273 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:02.695268 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d19b1b87-8d64-4add-89c5-6b4361611273 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:02.846361 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d19b1b87-8d64-4add-89c5-6b4361611273 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:02.855038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d19b1b87-8d64-4add-89c5-6b4361611273 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.182879 Feb 10 03:40:02.855913 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 246/499] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:02 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:03.237610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:03.238250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:03.248517 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:03.248969 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:03.249745 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:03.250180 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:03.396404 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:03.405727 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:03.407739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:03.409126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1c87a275-66e2-4263-94ab-e71741d40fa5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.175892 Feb 10 03:40:03.410197 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 254/500] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:03 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:03.553300 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dc328b1f-0fd9-4b62-941b-870936bf7554 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:03.553922 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dc328b1f-0fd9-4b62-941b-870936bf7554 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:03.560383 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dc328b1f-0fd9-4b62-941b-870936bf7554 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:03.560819 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dc328b1f-0fd9-4b62-941b-870936bf7554 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:03.561585 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dc328b1f-0fd9-4b62-941b-870936bf7554 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:03.562072 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dc328b1f-0fd9-4b62-941b-870936bf7554 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:03.708730 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dc328b1f-0fd9-4b62-941b-870936bf7554 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:03.719257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dc328b1f-0fd9-4b62-941b-870936bf7554 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.168584 Feb 10 03:40:03.719257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 247/501] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:03 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:03.872126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-03f7914e-12fa-49a1-aa9c-931d592e6cd3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:03.872849 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-03f7914e-12fa-49a1-aa9c-931d592e6cd3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:03.879324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-03f7914e-12fa-49a1-aa9c-931d592e6cd3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:03.879765 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-03f7914e-12fa-49a1-aa9c-931d592e6cd3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:03.880548 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-03f7914e-12fa-49a1-aa9c-931d592e6cd3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:03.880976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-03f7914e-12fa-49a1-aa9c-931d592e6cd3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:04.041232 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-03f7914e-12fa-49a1-aa9c-931d592e6cd3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:04.049727 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-03f7914e-12fa-49a1-aa9c-931d592e6cd3 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.181763 Feb 10 03:40:04.050305 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 255/502] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:03 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:04.428082 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:04.429160 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:04.437640 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:04.438083 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:04.439179 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:04.439620 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:04.589818 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:04.598705 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:04.600328 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:04.601546 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6f98c1a9-1e5a-4ad5-805b-2dc25b1779cf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.177423 Feb 10 03:40:04.602095 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 248/503] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:04 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:04.735881 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ca86ed34-53ad-48db-9682-4945f81233e4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:04.736421 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ca86ed34-53ad-48db-9682-4945f81233e4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:04.742476 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ca86ed34-53ad-48db-9682-4945f81233e4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:04.742967 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ca86ed34-53ad-48db-9682-4945f81233e4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:04.743767 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ca86ed34-53ad-48db-9682-4945f81233e4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:04.744201 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ca86ed34-53ad-48db-9682-4945f81233e4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:04.886103 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ca86ed34-53ad-48db-9682-4945f81233e4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:04.893986 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ca86ed34-53ad-48db-9682-4945f81233e4 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.162021 Feb 10 03:40:04.894699 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 256/504] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:04 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:05.065990 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-26478ca6-28c3-4de4-97db-5b7a28c80ad4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:05.066701 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-26478ca6-28c3-4de4-97db-5b7a28c80ad4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:05.074004 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-26478ca6-28c3-4de4-97db-5b7a28c80ad4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:05.074461 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-26478ca6-28c3-4de4-97db-5b7a28c80ad4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:05.075321 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-26478ca6-28c3-4de4-97db-5b7a28c80ad4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:05.075752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-26478ca6-28c3-4de4-97db-5b7a28c80ad4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:05.227681 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-26478ca6-28c3-4de4-97db-5b7a28c80ad4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:05.235858 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-26478ca6-28c3-4de4-97db-5b7a28c80ad4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.173525 Feb 10 03:40:05.243716 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 249/505] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:05 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:05.624483 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:05.625542 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:05.633134 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:05.633567 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:05.634597 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:05.635369 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:05.787744 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:05.796837 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:05.798372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:05.799592 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-79db0cc6-cd34-4661-ac5d-6519e2fea006 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.181952 Feb 10 03:40:05.800502 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 257/506] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:05 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:05.911689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-45212e16-37af-433c-8b15-686439dfa95f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:05.912305 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-45212e16-37af-433c-8b15-686439dfa95f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:05.918507 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-45212e16-37af-433c-8b15-686439dfa95f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:05.918982 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-45212e16-37af-433c-8b15-686439dfa95f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:05.919832 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-45212e16-37af-433c-8b15-686439dfa95f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:05.920628 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-45212e16-37af-433c-8b15-686439dfa95f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:06.066458 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-45212e16-37af-433c-8b15-686439dfa95f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:06.074146 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-45212e16-37af-433c-8b15-686439dfa95f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.166224 Feb 10 03:40:06.074778 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 250/507] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:05 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:06.253452 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-79dd966c-46ae-4cf3-8546-cce142660757 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:06.254034 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-79dd966c-46ae-4cf3-8546-cce142660757 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:06.261053 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79dd966c-46ae-4cf3-8546-cce142660757 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:06.261500 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79dd966c-46ae-4cf3-8546-cce142660757 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:06.262458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79dd966c-46ae-4cf3-8546-cce142660757 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:06.262924 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79dd966c-46ae-4cf3-8546-cce142660757 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:06.415569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-79dd966c-46ae-4cf3-8546-cce142660757 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:06.423390 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-79dd966c-46ae-4cf3-8546-cce142660757 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.173869 Feb 10 03:40:06.423961 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 258/508] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:06 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:06.817429 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:06.818030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:06.824528 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:06.824974 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:06.826011 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:06.826415 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:06.966238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:06.975015 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:06.976498 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:06.977690 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-40a6d469-1fcf-45b4-91a4-4f1511c45122 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.164127 Feb 10 03:40:06.980634 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 251/509] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:06 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:07.091177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-69c3516e-928d-4884-a5f7-2daa2387c943 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:07.091798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-69c3516e-928d-4884-a5f7-2daa2387c943 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:07.098321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-69c3516e-928d-4884-a5f7-2daa2387c943 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:07.098793 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-69c3516e-928d-4884-a5f7-2daa2387c943 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:07.099555 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-69c3516e-928d-4884-a5f7-2daa2387c943 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:07.099981 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-69c3516e-928d-4884-a5f7-2daa2387c943 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:07.238303 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-69c3516e-928d-4884-a5f7-2daa2387c943 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:07.246126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-69c3516e-928d-4884-a5f7-2daa2387c943 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.158622 Feb 10 03:40:07.246672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 259/510] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:07 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:07.445326 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ab68d1d9-c344-4937-8b0a-946582729343 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:07.446346 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ab68d1d9-c344-4937-8b0a-946582729343 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:07.456092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ab68d1d9-c344-4937-8b0a-946582729343 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:07.456537 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ab68d1d9-c344-4937-8b0a-946582729343 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:07.457334 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ab68d1d9-c344-4937-8b0a-946582729343 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:07.457796 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ab68d1d9-c344-4937-8b0a-946582729343 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:07.594336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ab68d1d9-c344-4937-8b0a-946582729343 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:07.602565 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ab68d1d9-c344-4937-8b0a-946582729343 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1513 microversion: 2.1 time: 0.163966 Feb 10 03:40:07.603313 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 252/511] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:07 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:07.999129 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:07.999863 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:08.006186 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:08.007187 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:08.007430 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:08.007926 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:08.229040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:08.238602 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:08.240603 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:08.241970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f1ebb727-fd4c-4ad2-9dd6-7ce7dec6bb3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.246977 Feb 10 03:40:08.246702 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 260/512] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:07 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:08.263265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e3b96bd5-0a65-426a-9eb1-b5e56600e1b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:08.263874 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e3b96bd5-0a65-426a-9eb1-b5e56600e1b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:08.270318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e3b96bd5-0a65-426a-9eb1-b5e56600e1b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:08.270810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e3b96bd5-0a65-426a-9eb1-b5e56600e1b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:08.271594 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e3b96bd5-0a65-426a-9eb1-b5e56600e1b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:08.272192 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e3b96bd5-0a65-426a-9eb1-b5e56600e1b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:08.353425 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-5e1691e6-f9c2-44c0-9910-4234d4fcc10a req-62774204-64bd-4949-98c1-6080dd5b484c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0296ee2e-4bd2-4e13-864a-6c80f1b54bf3", "name": "network-vif-deleted", "tag": "53940bd9-b20a-45d0-989c-c2c1a1dd9c69"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:08.355261 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:40:08.355261 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:40:08.367711 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-5e1691e6-f9c2-44c0-9910-4234d4fcc10a req-62774204-64bd-4949-98c1-6080dd5b484c service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:08.369271 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-5e1691e6-f9c2-44c0-9910-4234d4fcc10a req-62774204-64bd-4949-98c1-6080dd5b484c service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:08.385410 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-5e1691e6-f9c2-44c0-9910-4234d4fcc10a req-62774204-64bd-4949-98c1-6080dd5b484c service nova] Creating event network-vif-deleted:53940bd9-b20a-45d0-989c-c2c1a1dd9c69 for instance 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 on hv-cinder-82806 Feb 10 03:40:08.390908 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-5e1691e6-f9c2-44c0-9910-4234d4fcc10a req-62774204-64bd-4949-98c1-6080dd5b484c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040961 Feb 10 03:40:08.392469 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 261/513] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:08.440851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e3b96bd5-0a65-426a-9eb1-b5e56600e1b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:08.449685 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e3b96bd5-0a65-426a-9eb1-b5e56600e1b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.190040 Feb 10 03:40:08.450456 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 253/514] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:08 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:08.620552 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:08.621261 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:08.628238 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:08.628689 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:08.629478 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:08.629910 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:08.661338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:08.661774 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:08.662245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lazy-loading 'fault' on Instance uuid 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:40:08.712686 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:08.722693 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5d93bf62-e87c-4d4b-9b53-aa57bb61ba4c tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 200 len: 1308 microversion: 2.1 time: 0.106697 Feb 10 03:40:08.723306 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 262/515] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:08 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:09.262100 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:09.262822 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:09.271168 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.271900 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.272656 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.273239 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.427251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:09.437974 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:09.440116 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:09.441379 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6e835827-e50e-4b09-9a22-5b7195398716 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.183907 Feb 10 03:40:09.441953 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 254/516] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:09 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:09.467722 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4cff60a9-2fc9-49fa-8a6d-5dbb58682c59 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:09.468326 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4cff60a9-2fc9-49fa-8a6d-5dbb58682c59 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:09.475155 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4cff60a9-2fc9-49fa-8a6d-5dbb58682c59 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.475594 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4cff60a9-2fc9-49fa-8a6d-5dbb58682c59 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.476361 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4cff60a9-2fc9-49fa-8a6d-5dbb58682c59 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.476789 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4cff60a9-2fc9-49fa-8a6d-5dbb58682c59 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.617997 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4cff60a9-2fc9-49fa-8a6d-5dbb58682c59 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:09.629316 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4cff60a9-2fc9-49fa-8a6d-5dbb58682c59 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.165072 Feb 10 03:40:09.630051 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 263/517] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:09 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:09.743880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:09.744489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:09.751531 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.751986 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.752790 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.753219 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.766535 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] HTTP exception thrown: Instance 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 could not be found. Feb 10 03:40:09.767143 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Returning 404 to user: Instance 0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:40:09.767934 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7334f7e9-1ddb-4020-a7cd-afc144c03ce9 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3" status: 404 len: 111 microversion: 2.1 time: 0.027853 Feb 10 03:40:09.768444 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 255/518] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:09 2022] GET /compute/v2.1/servers/0296ee2e-4bd2-4e13-864a-6c80f1b54bf3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:09.776739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2b0e0d08-a967-4a7c-93b1-1eb0e4aaaaa4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:09.777237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2b0e0d08-a967-4a7c-93b1-1eb0e4aaaaa4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:09.783613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b0e0d08-a967-4a7c-93b1-1eb0e4aaaaa4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.784059 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b0e0d08-a967-4a7c-93b1-1eb0e4aaaaa4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.784826 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b0e0d08-a967-4a7c-93b1-1eb0e4aaaaa4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.785254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b0e0d08-a967-4a7c-93b1-1eb0e4aaaaa4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.809203 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2b0e0d08-a967-4a7c-93b1-1eb0e4aaaaa4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:40:09.889785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2b0e0d08-a967-4a7c-93b1-1eb0e4aaaaa4 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 204 len: 0 microversion: 2.1 time: 0.116140 Feb 10 03:40:09.894088 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 264/519] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:40:09 2022] DELETE /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:40:09.899100 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1ec7ef61-d1a1-4c44-b1ce-fe6c36b9b21e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:09.899704 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1ec7ef61-d1a1-4c44-b1ce-fe6c36b9b21e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:09.905800 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1ec7ef61-d1a1-4c44-b1ce-fe6c36b9b21e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.906238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1ec7ef61-d1a1-4c44-b1ce-fe6c36b9b21e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:09.907030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1ec7ef61-d1a1-4c44-b1ce-fe6c36b9b21e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:09.907461 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1ec7ef61-d1a1-4c44-b1ce-fe6c36b9b21e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:10.045266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1ec7ef61-d1a1-4c44-b1ce-fe6c36b9b21e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:10.056408 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1ec7ef61-d1a1-4c44-b1ce-fe6c36b9b21e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1513 microversion: 2.1 time: 0.161106 Feb 10 03:40:10.056978 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 256/520] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:09 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:10.460380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:10.461067 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:10.467674 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:10.468119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:10.468882 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:10.469311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:10.611817 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:10.621460 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:10.622997 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:10.624177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f93f6008-352f-41ea-a2b4-61798c453c4f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.167912 Feb 10 03:40:10.624807 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 265/521] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:10 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:10.650696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-35b81829-8927-4e33-bb02-14d653863fef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:10.651536 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-35b81829-8927-4e33-bb02-14d653863fef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:10.658216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-35b81829-8927-4e33-bb02-14d653863fef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:10.658683 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-35b81829-8927-4e33-bb02-14d653863fef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:10.659475 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-35b81829-8927-4e33-bb02-14d653863fef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:10.659906 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-35b81829-8927-4e33-bb02-14d653863fef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:10.797348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-35b81829-8927-4e33-bb02-14d653863fef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:10.804813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-35b81829-8927-4e33-bb02-14d653863fef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.158017 Feb 10 03:40:10.805374 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 257/522] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:10 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:11.073512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c38decde-7445-4a57-8b6c-32a60f1c520e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:11.074176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c38decde-7445-4a57-8b6c-32a60f1c520e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:11.080736 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c38decde-7445-4a57-8b6c-32a60f1c520e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:11.081342 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c38decde-7445-4a57-8b6c-32a60f1c520e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:11.082150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c38decde-7445-4a57-8b6c-32a60f1c520e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:11.082682 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c38decde-7445-4a57-8b6c-32a60f1c520e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:11.230590 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c38decde-7445-4a57-8b6c-32a60f1c520e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:11.238597 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c38decde-7445-4a57-8b6c-32a60f1c520e tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1513 microversion: 2.1 time: 0.169077 Feb 10 03:40:11.239398 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 266/523] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:11 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:11.648630 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:11.649232 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:11.656479 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:11.657107 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:11.657787 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:11.658220 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:11.806329 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:11.815215 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:11.816783 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:11.817939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c716cd62-a8ec-4ef8-9834-a26055436bd0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.173134 Feb 10 03:40:11.818488 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 258/524] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:11 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:11.821172 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d84364ca-6102-421c-9a63-ba5bdfa26a94 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:11.821837 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d84364ca-6102-421c-9a63-ba5bdfa26a94 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:11.828334 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d84364ca-6102-421c-9a63-ba5bdfa26a94 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:11.828784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d84364ca-6102-421c-9a63-ba5bdfa26a94 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:11.829567 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d84364ca-6102-421c-9a63-ba5bdfa26a94 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:11.829970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d84364ca-6102-421c-9a63-ba5bdfa26a94 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:11.968770 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d84364ca-6102-421c-9a63-ba5bdfa26a94 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:11.976709 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d84364ca-6102-421c-9a63-ba5bdfa26a94 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.159182 Feb 10 03:40:11.977215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 267/525] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:11 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:12.256269 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dee6aaf2-3294-42e6-b7c0-488c50126f37 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:12.256902 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dee6aaf2-3294-42e6-b7c0-488c50126f37 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:12.263454 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dee6aaf2-3294-42e6-b7c0-488c50126f37 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:12.263905 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dee6aaf2-3294-42e6-b7c0-488c50126f37 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:12.264677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dee6aaf2-3294-42e6-b7c0-488c50126f37 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:12.265088 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dee6aaf2-3294-42e6-b7c0-488c50126f37 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:12.325087 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dee6aaf2-3294-42e6-b7c0-488c50126f37 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:12.335549 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dee6aaf2-3294-42e6-b7c0-488c50126f37 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 200 len: 1471 microversion: 2.1 time: 0.083000 Feb 10 03:40:12.336127 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 259/526] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:12 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:40:12.389978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-b1cc1714-3944-471c-b00f-ac9955137132 req-4447c68a-2bf3-4657-830c-126e0c16655e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5026c864-be6c-4702-bd77-88580b382ce7", "name": "network-vif-deleted", "tag": "73b9af4c-1633-4ce7-bedf-db767aba25bf"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:12.391608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:40:12.391608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:40:12.398923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-b1cc1714-3944-471c-b00f-ac9955137132 req-4447c68a-2bf3-4657-830c-126e0c16655e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:12.399396 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-b1cc1714-3944-471c-b00f-ac9955137132 req-4447c68a-2bf3-4657-830c-126e0c16655e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:12.411408 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-b1cc1714-3944-471c-b00f-ac9955137132 req-4447c68a-2bf3-4657-830c-126e0c16655e service nova] Creating event network-vif-deleted:73b9af4c-1633-4ce7-bedf-db767aba25bf for instance 5026c864-be6c-4702-bd77-88580b382ce7 on hv-cinder-82806 Feb 10 03:40:12.416642 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-b1cc1714-3944-471c-b00f-ac9955137132 req-4447c68a-2bf3-4657-830c-126e0c16655e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030235 Feb 10 03:40:12.418815 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 268/527] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:12.840060 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:12.841099 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:12.851734 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:12.852513 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:12.853738 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:12.854452 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:12.993070 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:12.994296 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-fb0fab06-a60b-4c25-ba4d-6b60bcd2db65 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:12.995567 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-fb0fab06-a60b-4c25-ba4d-6b60bcd2db65 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:13.001889 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fb0fab06-a60b-4c25-ba4d-6b60bcd2db65 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:13.002519 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:13.002763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fb0fab06-a60b-4c25-ba4d-6b60bcd2db65 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:13.003626 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fb0fab06-a60b-4c25-ba4d-6b60bcd2db65 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:13.004038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:13.004190 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fb0fab06-a60b-4c25-ba4d-6b60bcd2db65 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:13.005244 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e11cb7ce-7d24-4cbb-a7d5-23dadcd98d13 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.171404 Feb 10 03:40:13.005781 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 260/528] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:12 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:13.144832 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-fb0fab06-a60b-4c25-ba4d-6b60bcd2db65 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:13.152672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-fb0fab06-a60b-4c25-ba4d-6b60bcd2db65 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.163028 Feb 10 03:40:13.153313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 269/529] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:12 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:13.356143 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:13.357180 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 5026c864-be6c-4702-bd77-88580b382ce7] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:13.364935 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:13.365375 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:13.366140 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:13.366566 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:13.380125 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] HTTP exception thrown: Instance 5026c864-be6c-4702-bd77-88580b382ce7 could not be found. Feb 10 03:40:13.380698 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Returning 404 to user: Instance 5026c864-be6c-4702-bd77-88580b382ce7 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:40:13.381486 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a32e3be5-3153-42a9-a6d3-277db7cc0317 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7" status: 404 len: 111 microversion: 2.1 time: 0.031569 Feb 10 03:40:13.382012 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 261/530] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:13 2022] GET /compute/v2.1/servers/5026c864-be6c-4702-bd77-88580b382ce7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:14.024238 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:14.024846 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:14.031608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:14.032080 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:14.032903 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:14.033338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:14.169167 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f141f536-49e9-4d91-922b-c906e293c5a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:14.169769 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f141f536-49e9-4d91-922b-c906e293c5a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:14.170474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:14.176460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f141f536-49e9-4d91-922b-c906e293c5a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:14.176919 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f141f536-49e9-4d91-922b-c906e293c5a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:14.177740 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f141f536-49e9-4d91-922b-c906e293c5a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:14.178209 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f141f536-49e9-4d91-922b-c906e293c5a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:14.178849 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:14.180357 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:14.181512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f52c05d6-dd4b-41ab-ab09-2c8ff8d3b7ca tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.161083 Feb 10 03:40:14.182082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 270/531] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:14 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:14.310257 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f141f536-49e9-4d91-922b-c906e293c5a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:14.321728 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f141f536-49e9-4d91-922b-c906e293c5a2 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.155997 Feb 10 03:40:14.322569 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 262/532] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:14 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:14.512399 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a9287ecd-73ed-4425-9224-f3e88b59e480 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:14.512830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a9287ecd-73ed-4425-9224-f3e88b59e480 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:14.519206 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a9287ecd-73ed-4425-9224-f3e88b59e480 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:14.519659 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a9287ecd-73ed-4425-9224-f3e88b59e480 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:14.520470 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a9287ecd-73ed-4425-9224-f3e88b59e480 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:14.520901 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a9287ecd-73ed-4425-9224-f3e88b59e480 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:14.545096 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a9287ecd-73ed-4425-9224-f3e88b59e480 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:40:14.619113 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a9287ecd-73ed-4425-9224-f3e88b59e480 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 204 len: 0 microversion: 2.1 time: 0.110054 Feb 10 03:40:14.620095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 271/533] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:40:14 2022] DELETE /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:40:14.629435 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9d381322-fcb2-4c77-970a-448be2d3960f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:14.630738 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9d381322-fcb2-4c77-970a-448be2d3960f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:14.637984 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9d381322-fcb2-4c77-970a-448be2d3960f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:14.638678 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9d381322-fcb2-4c77-970a-448be2d3960f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:14.639479 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9d381322-fcb2-4c77-970a-448be2d3960f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:14.639947 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9d381322-fcb2-4c77-970a-448be2d3960f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:14.782119 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-9d381322-fcb2-4c77-970a-448be2d3960f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:14.790534 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9d381322-fcb2-4c77-970a-448be2d3960f tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1513 microversion: 2.1 time: 0.165790 Feb 10 03:40:14.791222 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 263/534] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:14 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:15.204410 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:15.205370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:15.212596 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:15.213090 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:15.213972 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:15.214443 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:15.341340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d661b32e-9704-4936-97ee-4b072d49c1ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:15.342004 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d661b32e-9704-4936-97ee-4b072d49c1ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:15.348648 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d661b32e-9704-4936-97ee-4b072d49c1ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:15.349102 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d661b32e-9704-4936-97ee-4b072d49c1ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:15.349881 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d661b32e-9704-4936-97ee-4b072d49c1ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:15.350318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d661b32e-9704-4936-97ee-4b072d49c1ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:15.353579 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:15.362514 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:15.364053 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:15.365218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-91cbdd5b-904a-4b96-92ce-fb4f841763e5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.167710 Feb 10 03:40:15.365768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 272/535] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:15 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:15.499633 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d661b32e-9704-4936-97ee-4b072d49c1ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:15.507433 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d661b32e-9704-4936-97ee-4b072d49c1ac tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.169870 Feb 10 03:40:15.508036 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 264/536] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:15 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:15.806899 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-47a0318e-35e8-438c-ba44-8ab269d2b715 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:15.807558 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-47a0318e-35e8-438c-ba44-8ab269d2b715 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:15.813420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-47a0318e-35e8-438c-ba44-8ab269d2b715 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:15.813860 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-47a0318e-35e8-438c-ba44-8ab269d2b715 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:15.814668 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-47a0318e-35e8-438c-ba44-8ab269d2b715 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:15.815149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-47a0318e-35e8-438c-ba44-8ab269d2b715 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:15.950145 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-47a0318e-35e8-438c-ba44-8ab269d2b715 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:15.957768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-47a0318e-35e8-438c-ba44-8ab269d2b715 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1513 microversion: 2.1 time: 0.154634 Feb 10 03:40:15.958344 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 273/537] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:15 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:16.387682 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:16.388599 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:16.396966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:16.397415 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:16.398199 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:16.398637 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:16.523852 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-41625c63-fafc-4e53-b2db-6d12e099908f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:16.524500 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-41625c63-fafc-4e53-b2db-6d12e099908f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:16.532203 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-41625c63-fafc-4e53-b2db-6d12e099908f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:16.532378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-41625c63-fafc-4e53-b2db-6d12e099908f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:16.533057 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-41625c63-fafc-4e53-b2db-6d12e099908f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:16.533496 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-41625c63-fafc-4e53-b2db-6d12e099908f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:16.547399 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:16.557709 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:16.559511 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:16.560997 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b706f981-1845-440e-9cf3-be76a55b8200 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.179582 Feb 10 03:40:16.571644 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 265/538] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:16 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:16.676345 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-41625c63-fafc-4e53-b2db-6d12e099908f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:16.684826 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-41625c63-fafc-4e53-b2db-6d12e099908f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.164561 Feb 10 03:40:16.694548 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 274/539] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:16 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:16.716297 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-b01c06b2-1ae0-4491-b723-fee590131a1b req-fa412fe6-56f1-4ed5-82b6-8d3127d4d603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d302b3d4-6282-4fbe-a4c4-248881ee8f51", "name": "network-vif-plugged", "status": "completed", "tag": "29a0a5b3-6729-4753-8ce5-55f51a8c9a2e"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:16.718265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:40:16.718265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:40:16.725822 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-b01c06b2-1ae0-4491-b723-fee590131a1b req-fa412fe6-56f1-4ed5-82b6-8d3127d4d603 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:16.726393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-b01c06b2-1ae0-4491-b723-fee590131a1b req-fa412fe6-56f1-4ed5-82b6-8d3127d4d603 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:16.738019 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-b01c06b2-1ae0-4491-b723-fee590131a1b req-fa412fe6-56f1-4ed5-82b6-8d3127d4d603 service nova] Creating event network-vif-plugged:29a0a5b3-6729-4753-8ce5-55f51a8c9a2e for instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 on hv-cinder-82806 Feb 10 03:40:16.743043 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-b01c06b2-1ae0-4491-b723-fee590131a1b req-fa412fe6-56f1-4ed5-82b6-8d3127d4d603 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030444 Feb 10 03:40:16.743641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 266/540] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:16.974763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d9974863-f9e8-4fcc-aa36-2d9967c26b1a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:16.975372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d9974863-f9e8-4fcc-aa36-2d9967c26b1a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:16.981322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d9974863-f9e8-4fcc-aa36-2d9967c26b1a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:16.981812 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d9974863-f9e8-4fcc-aa36-2d9967c26b1a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:16.982558 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d9974863-f9e8-4fcc-aa36-2d9967c26b1a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:16.983082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d9974863-f9e8-4fcc-aa36-2d9967c26b1a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:17.127018 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d9974863-f9e8-4fcc-aa36-2d9967c26b1a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:17.134357 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d9974863-f9e8-4fcc-aa36-2d9967c26b1a tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1513 microversion: 2.1 time: 0.163442 Feb 10 03:40:17.135240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 275/541] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:16 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:17.580625 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:17.581979 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:17.590153 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:17.590732 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:17.591543 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:17.592159 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:17.680704 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-cdd4e598-70ee-404f-8e3d-0a08eb3282ec req-19827292-b545-44c6-8320-5b1ea4e3facb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28168573-b016-4c85-a32c-158c4155cd28", "name": "network-vif-deleted", "tag": "beb068b9-e15c-4f4f-92d7-1c14f685b47d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:17.682613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:40:17.682613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:40:17.690324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-cdd4e598-70ee-404f-8e3d-0a08eb3282ec req-19827292-b545-44c6-8320-5b1ea4e3facb service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:17.690793 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-cdd4e598-70ee-404f-8e3d-0a08eb3282ec req-19827292-b545-44c6-8320-5b1ea4e3facb service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:17.702288 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-cdd4e598-70ee-404f-8e3d-0a08eb3282ec req-19827292-b545-44c6-8320-5b1ea4e3facb service nova] Creating event network-vif-deleted:beb068b9-e15c-4f4f-92d7-1c14f685b47d for instance 28168573-b016-4c85-a32c-158c4155cd28 on hv-cinder-82806 Feb 10 03:40:17.707380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-cdd4e598-70ee-404f-8e3d-0a08eb3282ec req-19827292-b545-44c6-8320-5b1ea4e3facb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030612 Feb 10 03:40:17.708056 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 276/542] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:40:17.712725 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-16a44c57-bad0-4111-b43f-9c49659e30e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:17.713411 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-16a44c57-bad0-4111-b43f-9c49659e30e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:17.719287 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-16a44c57-bad0-4111-b43f-9c49659e30e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:17.719754 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-16a44c57-bad0-4111-b43f-9c49659e30e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:17.720603 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-16a44c57-bad0-4111-b43f-9c49659e30e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:17.721034 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-16a44c57-bad0-4111-b43f-9c49659e30e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:17.735828 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:17.744315 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:17.746208 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:17.747385 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a997baad-27ce-4cf6-b9c4-f24ba369b7ea tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.171597 Feb 10 03:40:17.747967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 267/543] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:17 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:17.879917 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-16a44c57-bad0-4111-b43f-9c49659e30e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:17.891164 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-16a44c57-bad0-4111-b43f-9c49659e30e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.181725 Feb 10 03:40:17.892830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 277/544] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:17 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:18.151531 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:18.152146 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:18.159974 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:18.160426 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:18.161409 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:18.161966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:18.194951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:18.195321 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:18.195842 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lazy-loading 'fault' on Instance uuid 28168573-b016-4c85-a32c-158c4155cd28 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:40:18.235713 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf0f1d005d4a1eb0136d4593b094b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bf7bed71094487b57906e39d043543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:18.243715 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-793e72a4-acd3-421f-92a3-5c3065002908 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 200 len: 1308 microversion: 2.1 time: 0.095949 Feb 10 03:40:18.244496 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 268/545] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:18 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:18.765390 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:18.766006 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:18.772739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:18.773191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:18.773959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:18.774377 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:18.909611 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a4ef7ef7-5790-48ba-aa2d-a986cb80672a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:18.910428 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a4ef7ef7-5790-48ba-aa2d-a986cb80672a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:18.912086 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:18.917266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4ef7ef7-5790-48ba-aa2d-a986cb80672a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:18.917802 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4ef7ef7-5790-48ba-aa2d-a986cb80672a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:18.918696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4ef7ef7-5790-48ba-aa2d-a986cb80672a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:18.919196 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4ef7ef7-5790-48ba-aa2d-a986cb80672a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:18.920953 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:18.922468 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:18.923854 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b26c7e5b-6c3c-4325-b514-aa661e65b070 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1807 microversion: 2.20 time: 0.162206 Feb 10 03:40:18.924622 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 278/546] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:18 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:19.066784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a4ef7ef7-5790-48ba-aa2d-a986cb80672a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:19.074208 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a4ef7ef7-5790-48ba-aa2d-a986cb80672a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.168559 Feb 10 03:40:19.074793 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 269/547] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:18 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:19.261332 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:19.261980 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] [instance: 28168573-b016-4c85-a32c-158c4155cd28] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:19.268571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:19.269015 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:19.270165 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:19.270165 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:19.283225 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] HTTP exception thrown: Instance 28168573-b016-4c85-a32c-158c4155cd28 could not be found. Feb 10 03:40:19.283803 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] Returning 404 to user: Instance 28168573-b016-4c85-a32c-158c4155cd28 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:40:19.284642 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1941cc93-462f-4567-a7da-79704a32d159 tempest-AttachVolumeNegativeTest-2037754030 tempest-AttachVolumeNegativeTest-2037754030-project] 10.222.0.32 "GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28" status: 404 len: 111 microversion: 2.1 time: 0.027278 Feb 10 03:40:19.285160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 279/548] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:19 2022] GET /compute/v2.1/servers/28168573-b016-4c85-a32c-158c4155cd28 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:19.941519 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:19.942178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:19.948626 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:19.949259 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:19.950040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:19.950481 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:20.088493 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:20.091263 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3d918611-8ed2-41d3-953f-1d70fc75ab68 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:20.091844 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3d918611-8ed2-41d3-953f-1d70fc75ab68 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:20.097783 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:20.097975 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3d918611-8ed2-41d3-953f-1d70fc75ab68 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:20.098457 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3d918611-8ed2-41d3-953f-1d70fc75ab68 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:20.099244 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3d918611-8ed2-41d3-953f-1d70fc75ab68 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:20.099377 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:20.099671 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3d918611-8ed2-41d3-953f-1d70fc75ab68 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:20.100469 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-efba1044-aa85-44cc-8e39-ec0c8dade4df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1794 microversion: 2.20 time: 0.162857 Feb 10 03:40:20.101024 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 270/549] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:40:19 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:40:20.245505 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3d918611-8ed2-41d3-953f-1d70fc75ab68 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:20.254960 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3d918611-8ed2-41d3-953f-1d70fc75ab68 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.167301 Feb 10 03:40:20.255536 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 280/550] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:20 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:40:21.113481 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a89dacf2-09ae-4f72-b00a-f1fea52d3566 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Action: 'create', calling method: .version_select at 0x7fe95a3f40d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-356736519"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:21.272008 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-499a75dc-e81e-48b0-8775-0e2bff3b846e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:21.272631 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-499a75dc-e81e-48b0-8775-0e2bff3b846e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:21.279541 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-499a75dc-e81e-48b0-8775-0e2bff3b846e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:21.279976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-499a75dc-e81e-48b0-8775-0e2bff3b846e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:21.280785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-499a75dc-e81e-48b0-8775-0e2bff3b846e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:21.281209 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-499a75dc-e81e-48b0-8775-0e2bff3b846e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:21.406596 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a89dacf2-09ae-4f72-b00a-f1fea52d3566 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.406396 Feb 10 03:40:21.407390 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 271/551] 10.222.0.32 () {60 vars in 1154 bytes} [Thu Feb 10 03:40:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 10 03:40:21.418418 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-840055cf-eeaf-4e97-9d88-f14f703d93da tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95a4329d0>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:21.423665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-499a75dc-e81e-48b0-8775-0e2bff3b846e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:21.432726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-499a75dc-e81e-48b0-8775-0e2bff3b846e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.164497 Feb 10 03:40:21.433291 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 281/552] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:21 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:21.465648 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-840055cf-eeaf-4e97-9d88-f14f703d93da tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025" status: 200 len: 344 microversion: 2.1 time: 0.050759 Feb 10 03:40:21.466348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 272/553] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:40:21 2022] GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:22.449180 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8a359fcb-a75d-4a7d-8059-16e7c0ec5076 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:22.449788 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8a359fcb-a75d-4a7d-8059-16e7c0ec5076 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:22.456571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a359fcb-a75d-4a7d-8059-16e7c0ec5076 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:22.457006 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a359fcb-a75d-4a7d-8059-16e7c0ec5076 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:22.457786 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a359fcb-a75d-4a7d-8059-16e7c0ec5076 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:22.458227 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8a359fcb-a75d-4a7d-8059-16e7c0ec5076 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:22.478471 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dd4fba9b-a521-492b-afc2-f48e93595f00 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95a432ee0>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:22.526338 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dd4fba9b-a521-492b-afc2-f48e93595f00 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025" status: 200 len: 345 microversion: 2.1 time: 0.052798 Feb 10 03:40:22.526926 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 273/554] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:40:22 2022] GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:22.537600 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-781f3356-7195-4f67-b07f-31aeb20e6a28 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Action: 'create', calling method: .version_select at 0x7fe95a3ff430>, body: {"snapshot": {"volume_id": "d96f328e-b950-4ff5-b936-d5c5f2fea025", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1445306694"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:22.603684 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8a359fcb-a75d-4a7d-8059-16e7c0ec5076 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:22.611800 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8a359fcb-a75d-4a7d-8059-16e7c0ec5076 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.166393 Feb 10 03:40:22.612937 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 282/555] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:22 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:22.691916 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-781f3356-7195-4f67-b07f-31aeb20e6a28 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.157858 Feb 10 03:40:22.692586 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 274/556] 10.222.0.32 () {60 vars in 1161 bytes} [Thu Feb 10 03:40:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:22.702275 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b498f692-e874-4d12-8414-b823ee57aa44 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95acb43a0>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:22.732507 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b498f692-e874-4d12-8414-b823ee57aa44 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f" status: 200 len: 287 microversion: 2.1 time: 0.033875 Feb 10 03:40:22.732994 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 283/557] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Feb 10 03:40:22 2022] GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:22.743178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9077b56a-98f2-4e28-89b2-0a2deed56ab6 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95a3add30>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:22.771861 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9077b56a-98f2-4e28-89b2-0a2deed56ab6 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032403 Feb 10 03:40:22.772755 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 275/558] 10.222.0.32 () {58 vars in 1139 bytes} [Thu Feb 10 03:40:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:22.782125 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f2a17eb8-0a95-48ee-b587-f8359a5501e9 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95ad243a0>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:22.810397 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f2a17eb8-0a95-48ee-b587-f8359a5501e9 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f" status: 200 len: 287 microversion: 2.1 time: 0.031809 Feb 10 03:40:22.811014 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 284/559] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Feb 10 03:40:22 2022] GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:23.630544 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-302bfdb9-e50d-4136-8163-5b6989f158b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:23.631455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-302bfdb9-e50d-4136-8163-5b6989f158b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:23.638629 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-302bfdb9-e50d-4136-8163-5b6989f158b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:23.639196 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-302bfdb9-e50d-4136-8163-5b6989f158b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:23.640041 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-302bfdb9-e50d-4136-8163-5b6989f158b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:23.640469 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-302bfdb9-e50d-4136-8163-5b6989f158b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:23.791813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-302bfdb9-e50d-4136-8163-5b6989f158b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:23.799553 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-302bfdb9-e50d-4136-8163-5b6989f158b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.173532 Feb 10 03:40:23.800283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 276/560] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:23 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:23.821778 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-40020222-b463-4852-a518-1ec2b6a079d5 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95abd08b0>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:23.851007 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-40020222-b463-4852-a518-1ec2b6a079d5 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f" status: 200 len: 287 microversion: 2.1 time: 0.033156 Feb 10 03:40:23.851560 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 285/561] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Feb 10 03:40:23 2022] GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:24.816923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-97e787f3-463a-4562-9441-a2f1e95aa8a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:24.817510 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-97e787f3-463a-4562-9441-a2f1e95aa8a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:24.824028 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97e787f3-463a-4562-9441-a2f1e95aa8a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:24.824460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97e787f3-463a-4562-9441-a2f1e95aa8a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:24.825247 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97e787f3-463a-4562-9441-a2f1e95aa8a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:24.825689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97e787f3-463a-4562-9441-a2f1e95aa8a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:24.863144 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5471561f-84cf-4193-a7a3-8a79f610d796 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95ad24b80>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:24.893610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5471561f-84cf-4193-a7a3-8a79f610d796 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f" status: 200 len: 287 microversion: 2.1 time: 0.034623 Feb 10 03:40:24.894176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 286/562] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Feb 10 03:40:24 2022] GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:25.036369 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-97e787f3-463a-4562-9441-a2f1e95aa8a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:25.049720 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-97e787f3-463a-4562-9441-a2f1e95aa8a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.236287 Feb 10 03:40:25.053272 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 277/563] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:24 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:25.905804 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0a81470d-f35d-4520-9495-83106d2eb3cd tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95ac3cd30>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:25.936426 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0a81470d-f35d-4520-9495-83106d2eb3cd tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f" status: 200 len: 288 microversion: 2.1 time: 0.034760 Feb 10 03:40:25.936969 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 287/564] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Feb 10 03:40:25 2022] GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:25.947180 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1314beaa-f5b4-4ac2-ad76-b42d8aa23f2b tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95a416940>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:26.027295 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1314beaa-f5b4-4ac2-ad76-b42d8aa23f2b tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f" status: 202 len: 0 microversion: 2.1 time: 0.082949 Feb 10 03:40:26.028079 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 278/565] 10.222.0.32 () {58 vars in 1253 bytes} [Thu Feb 10 03:40:25 2022] DELETE /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:40:26.038788 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-93d8b1ee-b398-4794-82ff-7b84bdf787f3 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95acb4670>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:26.071183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-93d8b1ee-b398-4794-82ff-7b84bdf787f3 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f" status: 200 len: 287 microversion: 2.1 time: 0.035957 Feb 10 03:40:26.071589 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f6a3a84b-5423-46aa-8200-a9c53bfdaf99 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:26.071806 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 288/566] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Feb 10 03:40:26 2022] GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:26.072998 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f6a3a84b-5423-46aa-8200-a9c53bfdaf99 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:26.079468 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f6a3a84b-5423-46aa-8200-a9c53bfdaf99 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:26.080411 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f6a3a84b-5423-46aa-8200-a9c53bfdaf99 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:26.081373 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f6a3a84b-5423-46aa-8200-a9c53bfdaf99 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:26.081810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f6a3a84b-5423-46aa-8200-a9c53bfdaf99 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:26.235015 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f6a3a84b-5423-46aa-8200-a9c53bfdaf99 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:26.242946 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f6a3a84b-5423-46aa-8200-a9c53bfdaf99 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.179599 Feb 10 03:40:26.243524 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 279/567] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:26 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:27.082910 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2ef4dff5-75ec-4bbc-bb6b-1942f3692b30 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95af71820>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:27.120927 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-2ef4dff5-75ec-4bbc-bb6b-1942f3692b30 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] HTTP exception thrown: Snapshot c343a3e0-d26f-4527-95fe-4b85a36b4e0f could not be found. Feb 10 03:40:27.121810 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2ef4dff5-75ec-4bbc-bb6b-1942f3692b30 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Returning 404 to user: Snapshot c343a3e0-d26f-4527-95fe-4b85a36b4e0f could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:40:27.122780 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2ef4dff5-75ec-4bbc-bb6b-1942f3692b30 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f" status: 404 len: 111 microversion: 2.1 time: 0.043582 Feb 10 03:40:27.123614 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 289/568] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Feb 10 03:40:27 2022] GET /compute/v2.1/os-snapshots/c343a3e0-d26f-4527-95fe-4b85a36b4e0f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:27.132216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7d54b20e-c115-4a0a-8a36-7630acf40dcf tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95a4161f0>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:27.242419 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7d54b20e-c115-4a0a-8a36-7630acf40dcf tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025" status: 202 len: 0 microversion: 2.1 time: 0.114055 Feb 10 03:40:27.243608 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 280/569] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Feb 10 03:40:27 2022] DELETE /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:40:27.254637 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-13dc2846-1f15-4d56-8d52-3c4dc59edff1 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95ad75310>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:27.260610 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ad019b46-c4cb-4d2c-835c-165ac8ddb8d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:27.261250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ad019b46-c4cb-4d2c-835c-165ac8ddb8d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:27.269160 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ad019b46-c4cb-4d2c-835c-165ac8ddb8d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:27.269617 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ad019b46-c4cb-4d2c-835c-165ac8ddb8d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:27.270734 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ad019b46-c4cb-4d2c-835c-165ac8ddb8d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:27.271492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ad019b46-c4cb-4d2c-835c-165ac8ddb8d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:27.316144 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-13dc2846-1f15-4d56-8d52-3c4dc59edff1 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025" status: 200 len: 344 microversion: 2.1 time: 0.067655 Feb 10 03:40:27.316775 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 290/570] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:40:27 2022] GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:27.626217 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ad019b46-c4cb-4d2c-835c-165ac8ddb8d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:27.635452 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ad019b46-c4cb-4d2c-835c-165ac8ddb8d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.378811 Feb 10 03:40:27.636088 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 281/571] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:27 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:28.329832 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4d34d3c6-f0c7-47e9-b76e-482c0aa1e642 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95acb4940>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:28.361435 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-4d34d3c6-f0c7-47e9-b76e-482c0aa1e642 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] HTTP exception thrown: Volume d96f328e-b950-4ff5-b936-d5c5f2fea025 could not be found. Feb 10 03:40:28.362317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4d34d3c6-f0c7-47e9-b76e-482c0aa1e642 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Returning 404 to user: Volume d96f328e-b950-4ff5-b936-d5c5f2fea025 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:40:28.363264 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4d34d3c6-f0c7-47e9-b76e-482c0aa1e642 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025" status: 404 len: 109 microversion: 2.1 time: 0.038214 Feb 10 03:40:28.363737 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 291/572] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:40:28 2022] GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:28.378286 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-79526ce6-4616-4356-b0cf-6188221e2c48 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95a40a940>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:28.413171 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-79526ce6-4616-4356-b0cf-6188221e2c48 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] HTTP exception thrown: Volume d96f328e-b950-4ff5-b936-d5c5f2fea025 could not be found. Feb 10 03:40:28.413772 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-79526ce6-4616-4356-b0cf-6188221e2c48 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Returning 404 to user: Volume d96f328e-b950-4ff5-b936-d5c5f2fea025 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:40:28.414636 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-79526ce6-4616-4356-b0cf-6188221e2c48 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025" status: 404 len: 109 microversion: 2.1 time: 0.040134 Feb 10 03:40:28.415206 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 282/573] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Feb 10 03:40:28 2022] DELETE /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:28.423231 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-267faaae-bc2b-4073-b0c2-28d34396b3f2 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Calling method '.version_select at 0x7fe95c1ec820>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:28.458788 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-267faaae-bc2b-4073-b0c2-28d34396b3f2 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] HTTP exception thrown: Volume d96f328e-b950-4ff5-b936-d5c5f2fea025 could not be found. Feb 10 03:40:28.459450 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-267faaae-bc2b-4073-b0c2-28d34396b3f2 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] Returning 404 to user: Volume d96f328e-b950-4ff5-b936-d5c5f2fea025 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:40:28.466035 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-267faaae-bc2b-4073-b0c2-28d34396b3f2 tempest-VolumesSnapshotsTestJSON-679410930 tempest-VolumesSnapshotsTestJSON-679410930-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025" status: 404 len: 109 microversion: 2.1 time: 0.042001 Feb 10 03:40:28.467010 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 292/574] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:40:28 2022] GET /compute/v2.1/os-volumes/d96f328e-b950-4ff5-b936-d5c5f2fea025 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:40:28.653182 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d9342ef7-5d81-4f94-b920-9078dcfc2811 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:28.656999 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d9342ef7-5d81-4f94-b920-9078dcfc2811 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:28.665721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d9342ef7-5d81-4f94-b920-9078dcfc2811 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:28.671093 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d9342ef7-5d81-4f94-b920-9078dcfc2811 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:28.672263 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d9342ef7-5d81-4f94-b920-9078dcfc2811 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:28.679091 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d9342ef7-5d81-4f94-b920-9078dcfc2811 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:28.909887 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d9342ef7-5d81-4f94-b920-9078dcfc2811 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:28.917862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d9342ef7-5d81-4f94-b920-9078dcfc2811 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1501 microversion: 2.1 time: 0.268372 Feb 10 03:40:28.934698 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33e09c57-8057-450c-9770-786d3a164497"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:28.936414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:28.942594 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 283/575] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:28 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:28.944478 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:28.945093 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:28.946025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:28.946629 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:28.971011 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] HTTP exception thrown: Cannot 'attach_volume' instance 699b7ed3-80f5-47d0-bcec-6801073102d6 while it is in vm_state rescued Feb 10 03:40:28.971958 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Returning 409 to user: Cannot 'attach_volume' instance 699b7ed3-80f5-47d0-bcec-6801073102d6 while it is in vm_state rescued {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:40:28.972943 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-55e86bd1-b660-4711-88e8-5da069da1713 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042523 Feb 10 03:40:28.981843 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0d6a7660-e0c6-4fd8-bb10-0e86f1b674a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:28.982641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0d6a7660-e0c6-4fd8-bb10-0e86f1b674a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:28.987864 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 293/576] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:40:28 2022] POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 10 03:40:28.989748 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d6a7660-e0c6-4fd8-bb10-0e86f1b674a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:28.990364 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d6a7660-e0c6-4fd8-bb10-0e86f1b674a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:28.991352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d6a7660-e0c6-4fd8-bb10-0e86f1b674a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:28.991937 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d6a7660-e0c6-4fd8-bb10-0e86f1b674a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:29.085203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0d6a7660-e0c6-4fd8-bb10-0e86f1b674a3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/action" status: 202 len: 0 microversion: 2.1 time: 0.106794 Feb 10 03:40:29.087526 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 284/577] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:40:28 2022] POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 10 03:40:29.096317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8221ccc8-cd9f-4313-a557-98d742e87ede tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:29.097075 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8221ccc8-cd9f-4313-a557-98d742e87ede tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:29.103816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8221ccc8-cd9f-4313-a557-98d742e87ede tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:29.104528 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8221ccc8-cd9f-4313-a557-98d742e87ede tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:29.105472 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8221ccc8-cd9f-4313-a557-98d742e87ede tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:29.106055 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8221ccc8-cd9f-4313-a557-98d742e87ede tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:29.280720 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8221ccc8-cd9f-4313-a557-98d742e87ede tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:29.294892 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8221ccc8-cd9f-4313-a557-98d742e87ede tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1509 microversion: 2.1 time: 0.203765 Feb 10 03:40:29.295906 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 294/578] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:29 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:30.312923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-07a48d92-1843-4bf9-865f-a56c7a64be39 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:30.314450 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-07a48d92-1843-4bf9-865f-a56c7a64be39 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:30.327087 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-07a48d92-1843-4bf9-865f-a56c7a64be39 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:30.327752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-07a48d92-1843-4bf9-865f-a56c7a64be39 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:30.329079 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-07a48d92-1843-4bf9-865f-a56c7a64be39 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:30.329743 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-07a48d92-1843-4bf9-865f-a56c7a64be39 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:30.568098 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-07a48d92-1843-4bf9-865f-a56c7a64be39 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:30.576285 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-07a48d92-1843-4bf9-865f-a56c7a64be39 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1509 microversion: 2.1 time: 0.267428 Feb 10 03:40:30.577405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 285/579] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:30 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:31.596573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-87e0b763-a2fc-40f2-8be1-436056e5109a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:31.598036 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-87e0b763-a2fc-40f2-8be1-436056e5109a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:31.605995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-87e0b763-a2fc-40f2-8be1-436056e5109a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:31.606512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-87e0b763-a2fc-40f2-8be1-436056e5109a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:31.607399 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-87e0b763-a2fc-40f2-8be1-436056e5109a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:31.608012 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-87e0b763-a2fc-40f2-8be1-436056e5109a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:31.818000 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-87e0b763-a2fc-40f2-8be1-436056e5109a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:31.828365 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-87e0b763-a2fc-40f2-8be1-436056e5109a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1509 microversion: 2.1 time: 0.237550 Feb 10 03:40:31.839169 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 295/580] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:31 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:32.847927 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-295d615f-09d2-46cd-a8f4-ef0353ff7a9d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:32.848786 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-295d615f-09d2-46cd-a8f4-ef0353ff7a9d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:32.861552 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-295d615f-09d2-46cd-a8f4-ef0353ff7a9d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:32.862465 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-295d615f-09d2-46cd-a8f4-ef0353ff7a9d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:32.864951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-295d615f-09d2-46cd-a8f4-ef0353ff7a9d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:32.866485 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-295d615f-09d2-46cd-a8f4-ef0353ff7a9d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:33.210037 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-295d615f-09d2-46cd-a8f4-ef0353ff7a9d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:33.220665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-295d615f-09d2-46cd-a8f4-ef0353ff7a9d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1515 microversion: 2.1 time: 0.376478 Feb 10 03:40:33.221862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 286/581] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:32 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1515 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:34.909654 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0fe50597-6e69-4faf-8b36-e12cb6fa3ef6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:34.913031 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0fe50597-6e69-4faf-8b36-e12cb6fa3ef6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:34.936922 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0fe50597-6e69-4faf-8b36-e12cb6fa3ef6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:34.938605 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0fe50597-6e69-4faf-8b36-e12cb6fa3ef6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:34.941557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0fe50597-6e69-4faf-8b36-e12cb6fa3ef6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:34.942192 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0fe50597-6e69-4faf-8b36-e12cb6fa3ef6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:35.179708 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0fe50597-6e69-4faf-8b36-e12cb6fa3ef6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:35.191480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0fe50597-6e69-4faf-8b36-e12cb6fa3ef6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1515 microversion: 2.1 time: 0.282711 Feb 10 03:40:35.204838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 296/582] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:34 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1515 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:35.208059 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-98e0e1e1-8688-4179-835c-b8957f9e599b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5374d800-d3db-4d91-9c6f-b09e1ed42134"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:35.209220 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-98e0e1e1-8688-4179-835c-b8957f9e599b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:35.215986 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-98e0e1e1-8688-4179-835c-b8957f9e599b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:35.216619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-98e0e1e1-8688-4179-835c-b8957f9e599b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:35.217574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-98e0e1e1-8688-4179-835c-b8957f9e599b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:35.218160 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-98e0e1e1-8688-4179-835c-b8957f9e599b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:35.575684 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-98e0e1e1-8688-4179-835c-b8957f9e599b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371443 Feb 10 03:40:35.580370 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 287/583] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:40:35 2022] POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:43.209782 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-11408655-49d5-4004-bd2a-e39e07f0dd7a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:43.211831 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-11408655-49d5-4004-bd2a-e39e07f0dd7a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:43.225438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-11408655-49d5-4004-bd2a-e39e07f0dd7a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:43.225872 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-11408655-49d5-4004-bd2a-e39e07f0dd7a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:43.226856 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-11408655-49d5-4004-bd2a-e39e07f0dd7a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:43.227474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-11408655-49d5-4004-bd2a-e39e07f0dd7a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:43.258457 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-11408655-49d5-4004-bd2a-e39e07f0dd7a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lazy-loading 'flavor' on Instance uuid 699b7ed3-80f5-47d0-bcec-6801073102d6 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:40:43.399376 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-11408655-49d5-4004-bd2a-e39e07f0dd7a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/action" status: 200 len: 32 microversion: 2.1 time: 0.193845 Feb 10 03:40:43.400761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 297/584] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:40:43 2022] POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:40:43.413300 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-321a1daa-f2f8-4e07-a39c-84ff51a642d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:43.414644 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-321a1daa-f2f8-4e07-a39c-84ff51a642d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:43.421477 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-321a1daa-f2f8-4e07-a39c-84ff51a642d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:43.422166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-321a1daa-f2f8-4e07-a39c-84ff51a642d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:43.423268 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-321a1daa-f2f8-4e07-a39c-84ff51a642d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:43.423654 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-321a1daa-f2f8-4e07-a39c-84ff51a642d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:43.596586 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-321a1daa-f2f8-4e07-a39c-84ff51a642d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:43.608307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-321a1daa-f2f8-4e07-a39c-84ff51a642d8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.202142 Feb 10 03:40:43.609270 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 288/585] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:43 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:44.626628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-20375c13-abf5-4f78-be24-4b673fa1d4ad tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:44.627350 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-20375c13-abf5-4f78-be24-4b673fa1d4ad tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:44.639823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20375c13-abf5-4f78-be24-4b673fa1d4ad tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:44.641039 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20375c13-abf5-4f78-be24-4b673fa1d4ad tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:44.643482 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20375c13-abf5-4f78-be24-4b673fa1d4ad tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:44.644572 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20375c13-abf5-4f78-be24-4b673fa1d4ad tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:44.833214 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-20375c13-abf5-4f78-be24-4b673fa1d4ad tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:44.841352 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-20375c13-abf5-4f78-be24-4b673fa1d4ad tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.219121 Feb 10 03:40:44.841912 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 298/586] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:44 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:45.058868 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-95b597b0-5623-4a8f-9753-8d4dca83479e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Action: 'create', calling method: .version_select at 0x7fe95a3411f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-900309155"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:45.073634 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-95b597b0-5623-4a8f-9753-8d4dca83479e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Getting quotas for project f8d44d08ec564e94b99156087796bf3d. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:40:45.077539 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-95b597b0-5623-4a8f-9753-8d4dca83479e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Getting quotas for user 3117cb6d65454365be315814d9d696cc and project f8d44d08ec564e94b99156087796bf3d. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:40:45.635202 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-95b597b0-5623-4a8f-9753-8d4dca83479e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Getting quotas for project f8d44d08ec564e94b99156087796bf3d. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:40:45.639035 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-95b597b0-5623-4a8f-9753-8d4dca83479e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Getting quotas for user 3117cb6d65454365be315814d9d696cc and project f8d44d08ec564e94b99156087796bf3d. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:40:45.652655 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-95b597b0-5623-4a8f-9753-8d4dca83479e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.597504 Feb 10 03:40:45.653346 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 289/587] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Feb 10 03:40:45 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:45.703973 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2031698114", "imageRef": "ed070ae7-a0f5-4c79-94a9-5a96216bfa04", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-900309155", "networks": [{"uuid": "c3e758e9-8c30-4511-9ae7-8ed1e299ebc5"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:45.754698 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] validate_networks() for [('c3e758e9-8c30-4511-9ae7-8ed1e299ebc5', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:40:45.857684 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f5c501e4-2d96-40ae-8884-ded19903f3b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:45.858260 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f5c501e4-2d96-40ae-8884-ded19903f3b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:45.864312 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5c501e4-2d96-40ae-8884-ded19903f3b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:45.864756 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5c501e4-2d96-40ae-8884-ded19903f3b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:45.865551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5c501e4-2d96-40ae-8884-ded19903f3b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:45.865977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5c501e4-2d96-40ae-8884-ded19903f3b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:46.104435 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f5c501e4-2d96-40ae-8884-ded19903f3b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:46.115279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f5c501e4-2d96-40ae-8884-ded19903f3b8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.261213 Feb 10 03:40:46.126920 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 290/588] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:45 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:46.148834 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-65fe8291-c218-40cb-afe8-3a5755d0f117 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:46.149322 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-65fe8291-c218-40cb-afe8-3a5755d0f117 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:46.155763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-65fe8291-c218-40cb-afe8-3a5755d0f117 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:46.156205 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-65fe8291-c218-40cb-afe8-3a5755d0f117 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:46.156979 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-65fe8291-c218-40cb-afe8-3a5755d0f117 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:46.157513 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-65fe8291-c218-40cb-afe8-3a5755d0f117 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:46.233801 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-65fe8291-c218-40cb-afe8-3a5755d0f117 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lazy-loading 'services' on Instance uuid d60b46a9-24cb-430f-83bd-3c74a87a08cd {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:40:46.257540 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:40:46.257958 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:40:46.258425 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:40:46.258857 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:40:46.259260 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:40:46.269424 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:46.270040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:46.270891 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:46.271335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:46.287840 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Getting quotas for project f8d44d08ec564e94b99156087796bf3d. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:40:46.292091 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Getting quotas for user 3117cb6d65454365be315814d9d696cc and project f8d44d08ec564e94b99156087796bf3d. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:40:46.303896 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:40:46.306253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ed070ae7-a0f5-4c79-94a9-5a96216bfa04',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:40:46.309698 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-65fe8291-c218-40cb-afe8-3a5755d0f117 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/os-volume_attachments/f18dbd14-7923-4730-95f3-c943e27878ae" status: 202 len: 0 microversion: 2.1 time: 0.164593 Feb 10 03:40:46.310299 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 291/589] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:40:46 2022] DELETE /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/os-volume_attachments/f18dbd14-7923-4730-95f3-c943e27878ae => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 10 03:40:46.352380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1c729029-8cf4-4055-a70a-028338b975fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651988 Feb 10 03:40:46.353335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 299/590] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:40:46.364935 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-765d6cc5-c2e2-4514-905a-b0e00c0167b0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:46.365696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-765d6cc5-c2e2-4514-905a-b0e00c0167b0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:46.427008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-765d6cc5-c2e2-4514-905a-b0e00c0167b0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:46.434121 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-765d6cc5-c2e2-4514-905a-b0e00c0167b0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1258 microversion: 2.1 time: 0.073549 Feb 10 03:40:46.434693 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 292/591] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:46 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:47.135301 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-26d38058-0605-405e-a2d2-1e886355893c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:47.136022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-26d38058-0605-405e-a2d2-1e886355893c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:47.143661 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26d38058-0605-405e-a2d2-1e886355893c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:47.144149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26d38058-0605-405e-a2d2-1e886355893c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:47.145047 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26d38058-0605-405e-a2d2-1e886355893c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:47.145574 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-26d38058-0605-405e-a2d2-1e886355893c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:47.291315 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-26d38058-0605-405e-a2d2-1e886355893c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:47.299062 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-26d38058-0605-405e-a2d2-1e886355893c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.168974 Feb 10 03:40:47.299713 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 300/592] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:47 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:47.450146 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-adcdfe44-8a45-4113-8d6d-89c50167bd91 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:47.450775 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-adcdfe44-8a45-4113-8d6d-89c50167bd91 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:47.458668 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-adcdfe44-8a45-4113-8d6d-89c50167bd91 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:47.459166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-adcdfe44-8a45-4113-8d6d-89c50167bd91 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:47.460030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-adcdfe44-8a45-4113-8d6d-89c50167bd91 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:47.460464 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-adcdfe44-8a45-4113-8d6d-89c50167bd91 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:47.520973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-adcdfe44-8a45-4113-8d6d-89c50167bd91 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:47.528692 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-adcdfe44-8a45-4113-8d6d-89c50167bd91 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1310 microversion: 2.1 time: 0.082250 Feb 10 03:40:47.529283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 293/593] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:47 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:48.316613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-841ce9ee-ae65-4ef8-a491-cf8858ee569d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:48.318114 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-841ce9ee-ae65-4ef8-a491-cf8858ee569d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:48.326268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-841ce9ee-ae65-4ef8-a491-cf8858ee569d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:48.327026 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-841ce9ee-ae65-4ef8-a491-cf8858ee569d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:48.328189 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-841ce9ee-ae65-4ef8-a491-cf8858ee569d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:48.328942 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-841ce9ee-ae65-4ef8-a491-cf8858ee569d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:48.498863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9f78868b-9195-4bb2-bbb3-9fbf18736a07 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:48.513482 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9f78868b-9195-4bb2-bbb3-9fbf18736a07 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:48.514735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9f78868b-9195-4bb2-bbb3-9fbf18736a07 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:48.539810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9f78868b-9195-4bb2-bbb3-9fbf18736a07 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Going to try to stop instance {{(pid=127951) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 10 03:40:48.550712 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-841ce9ee-ae65-4ef8-a491-cf8858ee569d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:48.568557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-841ce9ee-ae65-4ef8-a491-cf8858ee569d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.254555 Feb 10 03:40:48.572911 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 301/594] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:48 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:48.596510 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d3885f7f-bac9-415e-9eac-80c44d6d7542 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:48.600223 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d3885f7f-bac9-415e-9eac-80c44d6d7542 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:48.602708 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9f78868b-9195-4bb2-bbb3-9fbf18736a07 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/action" status: 202 len: 0 microversion: 2.1 time: 0.107188 Feb 10 03:40:48.604569 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 294/595] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:40:48 2022] POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:40:48.622461 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d3885f7f-bac9-415e-9eac-80c44d6d7542 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:48.624608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d3885f7f-bac9-415e-9eac-80c44d6d7542 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:48.625901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e2325e3c-f11c-42b7-a334-a00bee9c5bd6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:48.627361 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e2325e3c-f11c-42b7-a334-a00bee9c5bd6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:48.636375 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d3885f7f-bac9-415e-9eac-80c44d6d7542 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:48.637091 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d3885f7f-bac9-415e-9eac-80c44d6d7542 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:48.638710 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e2325e3c-f11c-42b7-a334-a00bee9c5bd6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:48.639996 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e2325e3c-f11c-42b7-a334-a00bee9c5bd6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:48.641786 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e2325e3c-f11c-42b7-a334-a00bee9c5bd6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:48.642912 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e2325e3c-f11c-42b7-a334-a00bee9c5bd6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:48.776871 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d3885f7f-bac9-415e-9eac-80c44d6d7542 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:48.789370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d3885f7f-bac9-415e-9eac-80c44d6d7542 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1316 microversion: 2.1 time: 0.212325 Feb 10 03:40:48.790881 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 302/596] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:48 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:48.864122 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e2325e3c-f11c-42b7-a334-a00bee9c5bd6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:48.872618 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e2325e3c-f11c-42b7-a334-a00bee9c5bd6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.261780 Feb 10 03:40:48.884690 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 295/597] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:48 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:40:49.588447 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-53a7f224-b5ed-40a9-8ad7-bed99dcf85a8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:49.589858 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-53a7f224-b5ed-40a9-8ad7-bed99dcf85a8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:49.596585 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-53a7f224-b5ed-40a9-8ad7-bed99dcf85a8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:49.597034 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-53a7f224-b5ed-40a9-8ad7-bed99dcf85a8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:49.597829 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-53a7f224-b5ed-40a9-8ad7-bed99dcf85a8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:49.598262 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-53a7f224-b5ed-40a9-8ad7-bed99dcf85a8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:49.761064 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-53a7f224-b5ed-40a9-8ad7-bed99dcf85a8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:49.774878 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-53a7f224-b5ed-40a9-8ad7-bed99dcf85a8 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.190043 Feb 10 03:40:49.786106 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 303/598] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:49 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:49.809089 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-aba68baf-7fbe-49f7-94c4-fb96e2a4e6fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:49.810354 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-aba68baf-7fbe-49f7-94c4-fb96e2a4e6fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:49.818606 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-aba68baf-7fbe-49f7-94c4-fb96e2a4e6fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:49.819240 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-aba68baf-7fbe-49f7-94c4-fb96e2a4e6fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:49.820038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-aba68baf-7fbe-49f7-94c4-fb96e2a4e6fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:49.820473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-aba68baf-7fbe-49f7-94c4-fb96e2a4e6fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:49.892086 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-494c0d1b-f0be-4a62-b2c7-f88929bb0c77 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:49.892697 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-494c0d1b-f0be-4a62-b2c7-f88929bb0c77 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:49.899382 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-494c0d1b-f0be-4a62-b2c7-f88929bb0c77 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:49.900255 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-494c0d1b-f0be-4a62-b2c7-f88929bb0c77 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:49.901268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-494c0d1b-f0be-4a62-b2c7-f88929bb0c77 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:49.901876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-494c0d1b-f0be-4a62-b2c7-f88929bb0c77 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:50.070360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-aba68baf-7fbe-49f7-94c4-fb96e2a4e6fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:50.078094 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-aba68baf-7fbe-49f7-94c4-fb96e2a4e6fd tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.274009 Feb 10 03:40:50.078848 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 296/599] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:49 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:50.129578 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-494c0d1b-f0be-4a62-b2c7-f88929bb0c77 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:50.141215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-494c0d1b-f0be-4a62-b2c7-f88929bb0c77 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.253280 Feb 10 03:40:50.141797 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 304/600] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:49 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:40:50.793179 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-37ab13b3-be11-43a5-98fb-7adc1b8edb84 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:50.793934 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-37ab13b3-be11-43a5-98fb-7adc1b8edb84 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:50.800789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-37ab13b3-be11-43a5-98fb-7adc1b8edb84 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:50.801270 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-37ab13b3-be11-43a5-98fb-7adc1b8edb84 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:50.802072 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-37ab13b3-be11-43a5-98fb-7adc1b8edb84 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:50.802836 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-37ab13b3-be11-43a5-98fb-7adc1b8edb84 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:50.946551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-37ab13b3-be11-43a5-98fb-7adc1b8edb84 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:50.955982 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-37ab13b3-be11-43a5-98fb-7adc1b8edb84 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.166562 Feb 10 03:40:50.956863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 297/601] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:50 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:40:51.096438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dc886454-19b2-4614-933a-85cef590dd48 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:51.097093 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dc886454-19b2-4614-933a-85cef590dd48 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:51.103719 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc886454-19b2-4614-933a-85cef590dd48 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:51.104154 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc886454-19b2-4614-933a-85cef590dd48 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:51.104926 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc886454-19b2-4614-933a-85cef590dd48 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:51.105356 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc886454-19b2-4614-933a-85cef590dd48 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:51.160133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-5fa87e42-4bb7-477a-95d8-58944539e9e9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:51.160747 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-5fa87e42-4bb7-477a-95d8-58944539e9e9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:51.167081 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5fa87e42-4bb7-477a-95d8-58944539e9e9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:51.167548 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5fa87e42-4bb7-477a-95d8-58944539e9e9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:51.168330 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5fa87e42-4bb7-477a-95d8-58944539e9e9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:51.168767 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5fa87e42-4bb7-477a-95d8-58944539e9e9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:51.288970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dc886454-19b2-4614-933a-85cef590dd48 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:51.297744 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dc886454-19b2-4614-933a-85cef590dd48 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.204577 Feb 10 03:40:51.298314 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 305/602] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:51 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:51.375075 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-5fa87e42-4bb7-477a-95d8-58944539e9e9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:51.384294 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-5fa87e42-4bb7-477a-95d8-58944539e9e9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.229039 Feb 10 03:40:51.384882 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 298/603] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:51 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:51.973370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4dbf7b84-171f-4d59-a53c-fd75f71f7044 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:51.974148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4dbf7b84-171f-4d59-a53c-fd75f71f7044 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:51.982441 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4dbf7b84-171f-4d59-a53c-fd75f71f7044 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:51.983219 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4dbf7b84-171f-4d59-a53c-fd75f71f7044 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:51.984205 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4dbf7b84-171f-4d59-a53c-fd75f71f7044 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:51.984829 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4dbf7b84-171f-4d59-a53c-fd75f71f7044 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:52.175712 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4dbf7b84-171f-4d59-a53c-fd75f71f7044 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:52.183791 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4dbf7b84-171f-4d59-a53c-fd75f71f7044 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.214810 Feb 10 03:40:52.184456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 306/604] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:51 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:52.315788 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-716ae07d-a848-4fd5-ade3-30cca37b3766 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:52.317066 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-716ae07d-a848-4fd5-ade3-30cca37b3766 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:52.325135 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-716ae07d-a848-4fd5-ade3-30cca37b3766 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:52.325719 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-716ae07d-a848-4fd5-ade3-30cca37b3766 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:52.326530 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-716ae07d-a848-4fd5-ade3-30cca37b3766 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:52.326999 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-716ae07d-a848-4fd5-ade3-30cca37b3766 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:52.401769 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-52b20e18-89aa-45da-ad06-36dca18701fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:52.402427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-52b20e18-89aa-45da-ad06-36dca18701fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:52.408989 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-52b20e18-89aa-45da-ad06-36dca18701fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:52.409474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-52b20e18-89aa-45da-ad06-36dca18701fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:52.410311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-52b20e18-89aa-45da-ad06-36dca18701fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:52.411106 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-52b20e18-89aa-45da-ad06-36dca18701fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:52.505414 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-716ae07d-a848-4fd5-ade3-30cca37b3766 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:52.516466 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-716ae07d-a848-4fd5-ade3-30cca37b3766 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.205331 Feb 10 03:40:52.519313 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 299/605] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:52 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:52.633842 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-52b20e18-89aa-45da-ad06-36dca18701fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:52.641420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-52b20e18-89aa-45da-ad06-36dca18701fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.243713 Feb 10 03:40:52.651317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 307/606] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:52 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:53.201146 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-983ad50d-6fa5-4e5b-b6a4-9564a9e95cd0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:53.203164 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-983ad50d-6fa5-4e5b-b6a4-9564a9e95cd0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:53.209254 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-983ad50d-6fa5-4e5b-b6a4-9564a9e95cd0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:53.209937 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-983ad50d-6fa5-4e5b-b6a4-9564a9e95cd0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:53.211156 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-983ad50d-6fa5-4e5b-b6a4-9564a9e95cd0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:53.211872 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-983ad50d-6fa5-4e5b-b6a4-9564a9e95cd0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:53.371459 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-983ad50d-6fa5-4e5b-b6a4-9564a9e95cd0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:53.380404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-983ad50d-6fa5-4e5b-b6a4-9564a9e95cd0 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.182659 Feb 10 03:40:53.381556 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 300/607] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:53 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:53.536552 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dbe066c2-af98-4d33-975c-bba13b351170 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:53.537228 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dbe066c2-af98-4d33-975c-bba13b351170 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:53.543340 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dbe066c2-af98-4d33-975c-bba13b351170 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:53.543611 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dbe066c2-af98-4d33-975c-bba13b351170 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:53.544368 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dbe066c2-af98-4d33-975c-bba13b351170 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:53.545051 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dbe066c2-af98-4d33-975c-bba13b351170 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:53.660462 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-5498dd10-dc2a-4433-a979-d6db736bbcdc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:53.661619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-5498dd10-dc2a-4433-a979-d6db736bbcdc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:53.673740 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5498dd10-dc2a-4433-a979-d6db736bbcdc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:53.676449 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5498dd10-dc2a-4433-a979-d6db736bbcdc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:53.677266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5498dd10-dc2a-4433-a979-d6db736bbcdc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:53.677707 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5498dd10-dc2a-4433-a979-d6db736bbcdc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:53.774097 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dbe066c2-af98-4d33-975c-bba13b351170 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:53.781879 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dbe066c2-af98-4d33-975c-bba13b351170 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.249382 Feb 10 03:40:53.794258 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 308/608] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:53 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:53.894111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-5498dd10-dc2a-4433-a979-d6db736bbcdc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:53.911227 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-5498dd10-dc2a-4433-a979-d6db736bbcdc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.255867 Feb 10 03:40:53.923649 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 301/609] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:53 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:40:54.397873 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-552a6df3-824b-4a55-bfd1-3f52524aaaef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:54.398808 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-552a6df3-824b-4a55-bfd1-3f52524aaaef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:54.406491 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-552a6df3-824b-4a55-bfd1-3f52524aaaef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:54.406960 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-552a6df3-824b-4a55-bfd1-3f52524aaaef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:54.407763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-552a6df3-824b-4a55-bfd1-3f52524aaaef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:54.408202 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-552a6df3-824b-4a55-bfd1-3f52524aaaef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:54.570674 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-552a6df3-824b-4a55-bfd1-3f52524aaaef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:54.580962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-552a6df3-824b-4a55-bfd1-3f52524aaaef tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.187016 Feb 10 03:40:54.582088 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 309/610] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:54 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:54.800992 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3ff202da-3e04-43ec-a08c-95daf23ac2d1 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:54.802371 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3ff202da-3e04-43ec-a08c-95daf23ac2d1 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:54.809903 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ff202da-3e04-43ec-a08c-95daf23ac2d1 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:54.810717 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ff202da-3e04-43ec-a08c-95daf23ac2d1 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:54.818422 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ff202da-3e04-43ec-a08c-95daf23ac2d1 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:54.819380 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ff202da-3e04-43ec-a08c-95daf23ac2d1 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:54.933889 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1c68b5af-0e40-47a5-9e48-192c09d8099d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:54.935595 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1c68b5af-0e40-47a5-9e48-192c09d8099d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:54.943266 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c68b5af-0e40-47a5-9e48-192c09d8099d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:54.943959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c68b5af-0e40-47a5-9e48-192c09d8099d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:54.945534 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c68b5af-0e40-47a5-9e48-192c09d8099d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:54.946224 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c68b5af-0e40-47a5-9e48-192c09d8099d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:55.008145 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3ff202da-3e04-43ec-a08c-95daf23ac2d1 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:55.017684 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3ff202da-3e04-43ec-a08c-95daf23ac2d1 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.220487 Feb 10 03:40:55.022878 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 302/611] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:54 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:55.157965 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1c68b5af-0e40-47a5-9e48-192c09d8099d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:55.170040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1c68b5af-0e40-47a5-9e48-192c09d8099d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.239266 Feb 10 03:40:55.170040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 310/612] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:54 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:55.598854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d87c7064-d6af-401e-bf3c-8f0a2dad98b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:55.599464 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d87c7064-d6af-401e-bf3c-8f0a2dad98b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:55.605495 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d87c7064-d6af-401e-bf3c-8f0a2dad98b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:55.605952 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d87c7064-d6af-401e-bf3c-8f0a2dad98b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:55.606795 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d87c7064-d6af-401e-bf3c-8f0a2dad98b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:55.607500 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d87c7064-d6af-401e-bf3c-8f0a2dad98b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:55.790709 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d87c7064-d6af-401e-bf3c-8f0a2dad98b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:55.798609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d87c7064-d6af-401e-bf3c-8f0a2dad98b6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.203556 Feb 10 03:40:55.799212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 303/613] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:55 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:56.038459 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3bedca50-8ada-4ed8-8f0d-0447764ed45b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:56.040104 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3bedca50-8ada-4ed8-8f0d-0447764ed45b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:56.047352 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3bedca50-8ada-4ed8-8f0d-0447764ed45b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:56.047798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3bedca50-8ada-4ed8-8f0d-0447764ed45b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:56.048586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3bedca50-8ada-4ed8-8f0d-0447764ed45b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:56.049017 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3bedca50-8ada-4ed8-8f0d-0447764ed45b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:56.187531 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-79ecfa93-0cd9-4316-b7de-03ecfb4df167 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:56.189533 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-79ecfa93-0cd9-4316-b7de-03ecfb4df167 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:56.197150 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79ecfa93-0cd9-4316-b7de-03ecfb4df167 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:56.197963 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79ecfa93-0cd9-4316-b7de-03ecfb4df167 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:56.199745 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79ecfa93-0cd9-4316-b7de-03ecfb4df167 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:56.200444 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79ecfa93-0cd9-4316-b7de-03ecfb4df167 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:56.247876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3bedca50-8ada-4ed8-8f0d-0447764ed45b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:56.263267 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3bedca50-8ada-4ed8-8f0d-0447764ed45b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.228499 Feb 10 03:40:56.272904 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 311/614] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:56 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:56.401527 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-79ecfa93-0cd9-4316-b7de-03ecfb4df167 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:56.409192 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-79ecfa93-0cd9-4316-b7de-03ecfb4df167 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.225801 Feb 10 03:40:56.412036 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 304/615] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:56 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:56.816295 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-969d94c1-01e8-4d88-87dc-17f94176e969 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:56.817389 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-969d94c1-01e8-4d88-87dc-17f94176e969 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:56.835361 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-969d94c1-01e8-4d88-87dc-17f94176e969 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:56.836168 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-969d94c1-01e8-4d88-87dc-17f94176e969 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:56.837206 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-969d94c1-01e8-4d88-87dc-17f94176e969 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:56.837820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-969d94c1-01e8-4d88-87dc-17f94176e969 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:57.032161 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-969d94c1-01e8-4d88-87dc-17f94176e969 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:57.040516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-969d94c1-01e8-4d88-87dc-17f94176e969 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.228385 Feb 10 03:40:57.042417 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 312/616] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:56 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:57.280733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f2f000c4-05e8-4009-879f-244642037fc4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:57.281335 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f2f000c4-05e8-4009-879f-244642037fc4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:57.288448 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2f000c4-05e8-4009-879f-244642037fc4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:57.288955 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2f000c4-05e8-4009-879f-244642037fc4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:57.289832 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2f000c4-05e8-4009-879f-244642037fc4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:57.290365 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f2f000c4-05e8-4009-879f-244642037fc4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:57.429608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e5ee3879-c218-4b6f-801c-34240996e093 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:57.432951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f2f000c4-05e8-4009-879f-244642037fc4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:57.436785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e5ee3879-c218-4b6f-801c-34240996e093 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:57.441698 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f2f000c4-05e8-4009-879f-244642037fc4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.165389 Feb 10 03:40:57.444504 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 305/617] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:57 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:57.456302 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e5ee3879-c218-4b6f-801c-34240996e093 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:57.456755 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e5ee3879-c218-4b6f-801c-34240996e093 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:57.457544 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e5ee3879-c218-4b6f-801c-34240996e093 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:57.457976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e5ee3879-c218-4b6f-801c-34240996e093 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:57.604627 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e5ee3879-c218-4b6f-801c-34240996e093 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:57.612287 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e5ee3879-c218-4b6f-801c-34240996e093 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.186911 Feb 10 03:40:57.612848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 313/618] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:57 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:40:58.059615 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-697c2179-60ba-458f-b863-cc9d54be276b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:58.060440 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-697c2179-60ba-458f-b863-cc9d54be276b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:58.067737 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-697c2179-60ba-458f-b863-cc9d54be276b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:58.068569 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-697c2179-60ba-458f-b863-cc9d54be276b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:58.069773 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-697c2179-60ba-458f-b863-cc9d54be276b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:58.070618 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-697c2179-60ba-458f-b863-cc9d54be276b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:58.259176 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-697c2179-60ba-458f-b863-cc9d54be276b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:58.273907 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-697c2179-60ba-458f-b863-cc9d54be276b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.217880 Feb 10 03:40:58.275058 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 306/619] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:58 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:58.316050 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-2c82564a-239f-4c15-847d-3456c24c241d req-e9270346-e431-4978-9aad-79796f51d2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a528a15b-6851-416c-9040-245fa3c93b88", "tag": "21a54a32-023a-446a-a188-568375c7704d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:40:58.317771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:40:58.317771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:40:58.326042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-2c82564a-239f-4c15-847d-3456c24c241d req-e9270346-e431-4978-9aad-79796f51d2ca service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:58.326512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-2c82564a-239f-4c15-847d-3456c24c241d req-e9270346-e431-4978-9aad-79796f51d2ca service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:58.342813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-2c82564a-239f-4c15-847d-3456c24c241d req-e9270346-e431-4978-9aad-79796f51d2ca service nova] Creating event network-changed:21a54a32-023a-446a-a188-568375c7704d for instance a528a15b-6851-416c-9040-245fa3c93b88 on hv-cinder-82806 Feb 10 03:40:58.347762 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-2c82564a-239f-4c15-847d-3456c24c241d req-e9270346-e431-4978-9aad-79796f51d2ca service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037274 Feb 10 03:40:58.348737 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 314/620] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:40:58.462440 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-71cbfd39-cf2d-4185-8b1e-32c6bb7502a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:58.465328 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-71cbfd39-cf2d-4185-8b1e-32c6bb7502a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:58.474013 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-71cbfd39-cf2d-4185-8b1e-32c6bb7502a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:58.474766 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-71cbfd39-cf2d-4185-8b1e-32c6bb7502a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:58.476009 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-71cbfd39-cf2d-4185-8b1e-32c6bb7502a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:58.476590 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-71cbfd39-cf2d-4185-8b1e-32c6bb7502a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:58.624973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-71cbfd39-cf2d-4185-8b1e-32c6bb7502a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:58.631072 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e86121eb-2981-4050-96b4-9ad249829dc0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:58.632109 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e86121eb-2981-4050-96b4-9ad249829dc0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:58.632240 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-71cbfd39-cf2d-4185-8b1e-32c6bb7502a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.174974 Feb 10 03:40:58.633084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 307/621] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:58 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:58.641027 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e86121eb-2981-4050-96b4-9ad249829dc0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:58.641503 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e86121eb-2981-4050-96b4-9ad249829dc0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:58.642483 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e86121eb-2981-4050-96b4-9ad249829dc0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:58.642953 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e86121eb-2981-4050-96b4-9ad249829dc0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:58.781478 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e86121eb-2981-4050-96b4-9ad249829dc0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:58.788928 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e86121eb-2981-4050-96b4-9ad249829dc0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.163044 Feb 10 03:40:58.798257 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 315/622] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:58 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:59.290852 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-10b81fd8-ca46-4ad5-b5e6-7ce70e09bb77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:59.291351 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-10b81fd8-ca46-4ad5-b5e6-7ce70e09bb77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:59.297280 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-10b81fd8-ca46-4ad5-b5e6-7ce70e09bb77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:59.297724 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-10b81fd8-ca46-4ad5-b5e6-7ce70e09bb77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:59.298501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-10b81fd8-ca46-4ad5-b5e6-7ce70e09bb77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:59.298973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-10b81fd8-ca46-4ad5-b5e6-7ce70e09bb77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:59.432488 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-10b81fd8-ca46-4ad5-b5e6-7ce70e09bb77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:59.440651 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-10b81fd8-ca46-4ad5-b5e6-7ce70e09bb77 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.153524 Feb 10 03:40:59.441219 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 308/623] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:59 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:59.652547 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-04369ec4-18fe-4110-a85c-6f222646c363 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:59.653501 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-04369ec4-18fe-4110-a85c-6f222646c363 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:59.662377 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04369ec4-18fe-4110-a85c-6f222646c363 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:59.662879 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04369ec4-18fe-4110-a85c-6f222646c363 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:59.663652 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04369ec4-18fe-4110-a85c-6f222646c363 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:59.664082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04369ec4-18fe-4110-a85c-6f222646c363 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:59.801739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-04369ec4-18fe-4110-a85c-6f222646c363 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:59.805741 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-5f992cc6-ad91-4a6b-a718-2ae3b829878e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:40:59.806336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-5f992cc6-ad91-4a6b-a718-2ae3b829878e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:40:59.809109 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-04369ec4-18fe-4110-a85c-6f222646c363 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.162772 Feb 10 03:40:59.809647 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 316/624] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:59 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:40:59.813075 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5f992cc6-ad91-4a6b-a718-2ae3b829878e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:59.813532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5f992cc6-ad91-4a6b-a718-2ae3b829878e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:59.814360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5f992cc6-ad91-4a6b-a718-2ae3b829878e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:40:59.814847 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5f992cc6-ad91-4a6b-a718-2ae3b829878e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:40:59.957586 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-5f992cc6-ad91-4a6b-a718-2ae3b829878e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:40:59.965425 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-5f992cc6-ad91-4a6b-a718-2ae3b829878e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.163495 Feb 10 03:40:59.965977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 309/625] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:40:59 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:00.457574 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a3791712-50e3-4227-b2a4-8be0953294fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:00.458175 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a3791712-50e3-4227-b2a4-8be0953294fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:00.464130 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a3791712-50e3-4227-b2a4-8be0953294fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:00.464573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a3791712-50e3-4227-b2a4-8be0953294fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:00.465335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a3791712-50e3-4227-b2a4-8be0953294fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:00.465763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a3791712-50e3-4227-b2a4-8be0953294fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:00.605379 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a3791712-50e3-4227-b2a4-8be0953294fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:00.616330 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a3791712-50e3-4227-b2a4-8be0953294fe tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.162806 Feb 10 03:41:00.616898 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 317/626] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:00 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:00.825314 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-76b8a1d0-f185-42a6-ba2c-8778c4441501 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:00.825923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-76b8a1d0-f185-42a6-ba2c-8778c4441501 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:00.832519 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76b8a1d0-f185-42a6-ba2c-8778c4441501 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:00.832972 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76b8a1d0-f185-42a6-ba2c-8778c4441501 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:00.833752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76b8a1d0-f185-42a6-ba2c-8778c4441501 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:00.834189 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76b8a1d0-f185-42a6-ba2c-8778c4441501 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:00.974942 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-76b8a1d0-f185-42a6-ba2c-8778c4441501 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:00.982515 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-76b8a1d0-f185-42a6-ba2c-8778c4441501 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.160886 Feb 10 03:41:00.982885 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b395ff58-a5cc-4226-abe2-d8f1faa3492b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:00.983346 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 310/627] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:00 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:00.983530 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b395ff58-a5cc-4226-abe2-d8f1faa3492b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:00.990261 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b395ff58-a5cc-4226-abe2-d8f1faa3492b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:00.990706 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b395ff58-a5cc-4226-abe2-d8f1faa3492b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:00.991509 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b395ff58-a5cc-4226-abe2-d8f1faa3492b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:00.991940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b395ff58-a5cc-4226-abe2-d8f1faa3492b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:01.130486 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b395ff58-a5cc-4226-abe2-d8f1faa3492b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:01.137955 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b395ff58-a5cc-4226-abe2-d8f1faa3492b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.159043 Feb 10 03:41:01.138524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 318/628] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:00 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:01.634374 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-cbb33607-ecae-4c7a-aaba-b8b7c76da583 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:01.635037 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-cbb33607-ecae-4c7a-aaba-b8b7c76da583 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:01.641475 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cbb33607-ecae-4c7a-aaba-b8b7c76da583 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:01.641929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cbb33607-ecae-4c7a-aaba-b8b7c76da583 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:01.642711 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cbb33607-ecae-4c7a-aaba-b8b7c76da583 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:01.643175 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cbb33607-ecae-4c7a-aaba-b8b7c76da583 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:01.798392 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cbb33607-ecae-4c7a-aaba-b8b7c76da583 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:01.806366 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-cbb33607-ecae-4c7a-aaba-b8b7c76da583 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.175719 Feb 10 03:41:01.807027 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 311/629] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:01 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:02.000578 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ea8a2abc-4043-4354-a1e7-4b2536791fba tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:02.001174 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ea8a2abc-4043-4354-a1e7-4b2536791fba tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:02.008187 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea8a2abc-4043-4354-a1e7-4b2536791fba tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:02.008476 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea8a2abc-4043-4354-a1e7-4b2536791fba tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:02.009248 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea8a2abc-4043-4354-a1e7-4b2536791fba tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:02.009672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea8a2abc-4043-4354-a1e7-4b2536791fba tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:02.143655 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ea8a2abc-4043-4354-a1e7-4b2536791fba tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:02.151498 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ea8a2abc-4043-4354-a1e7-4b2536791fba tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.154902 Feb 10 03:41:02.152039 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 319/630] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:01 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:02.156425 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d3288e36-a226-44d7-afe8-20e0746dfac7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:02.157124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d3288e36-a226-44d7-afe8-20e0746dfac7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:02.165485 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d3288e36-a226-44d7-afe8-20e0746dfac7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:02.165945 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d3288e36-a226-44d7-afe8-20e0746dfac7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:02.166763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d3288e36-a226-44d7-afe8-20e0746dfac7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:02.167205 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d3288e36-a226-44d7-afe8-20e0746dfac7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:02.551206 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d3288e36-a226-44d7-afe8-20e0746dfac7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:02.558678 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d3288e36-a226-44d7-afe8-20e0746dfac7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.407518 Feb 10 03:41:02.559251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 312/631] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:02 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:02.823666 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4b8a5f3f-febc-4552-89b0-345120cf3a91 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:02.824593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4b8a5f3f-febc-4552-89b0-345120cf3a91 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:02.831298 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4b8a5f3f-febc-4552-89b0-345120cf3a91 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:02.831828 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4b8a5f3f-febc-4552-89b0-345120cf3a91 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:02.832795 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4b8a5f3f-febc-4552-89b0-345120cf3a91 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:02.833321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4b8a5f3f-febc-4552-89b0-345120cf3a91 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:02.977019 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4b8a5f3f-febc-4552-89b0-345120cf3a91 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:02.988178 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4b8a5f3f-febc-4552-89b0-345120cf3a91 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.168285 Feb 10 03:41:02.988762 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 320/632] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:02 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:03.040191 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-60c5bf9c-229b-48e0-b41a-14f2eb37c6a6 req-66682b73-58d9-4f87-804b-4aa4a7d28ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a528a15b-6851-416c-9040-245fa3c93b88", "name": "network-vif-plugged", "status": "completed", "tag": "21a54a32-023a-446a-a188-568375c7704d"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:03.042195 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:03.042195 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:41:03.050897 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-60c5bf9c-229b-48e0-b41a-14f2eb37c6a6 req-66682b73-58d9-4f87-804b-4aa4a7d28ff1 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:03.051492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-60c5bf9c-229b-48e0-b41a-14f2eb37c6a6 req-66682b73-58d9-4f87-804b-4aa4a7d28ff1 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:03.065043 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-60c5bf9c-229b-48e0-b41a-14f2eb37c6a6 req-66682b73-58d9-4f87-804b-4aa4a7d28ff1 service nova] Creating event network-vif-plugged:21a54a32-023a-446a-a188-568375c7704d for instance a528a15b-6851-416c-9040-245fa3c93b88 on hv-cinder-82806 Feb 10 03:41:03.071160 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-60c5bf9c-229b-48e0-b41a-14f2eb37c6a6 req-66682b73-58d9-4f87-804b-4aa4a7d28ff1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Feb 10 03:41:03.072059 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 313/633] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:03.171151 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-25cf59e0-b7fe-44ba-bda7-097f3815a654 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:03.171750 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-25cf59e0-b7fe-44ba-bda7-097f3815a654 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:03.183417 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-25cf59e0-b7fe-44ba-bda7-097f3815a654 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:03.183417 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-25cf59e0-b7fe-44ba-bda7-097f3815a654 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:03.184103 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-25cf59e0-b7fe-44ba-bda7-097f3815a654 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:03.184575 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-25cf59e0-b7fe-44ba-bda7-097f3815a654 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:03.337541 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-25cf59e0-b7fe-44ba-bda7-097f3815a654 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:03.344946 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-25cf59e0-b7fe-44ba-bda7-097f3815a654 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.177606 Feb 10 03:41:03.345508 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 321/634] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:03 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:03.578145 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3ef01a87-e5ea-429f-81ef-5121afb4832e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:03.579042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3ef01a87-e5ea-429f-81ef-5121afb4832e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:03.587489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ef01a87-e5ea-429f-81ef-5121afb4832e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:03.588055 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ef01a87-e5ea-429f-81ef-5121afb4832e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:03.589019 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ef01a87-e5ea-429f-81ef-5121afb4832e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:03.589601 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ef01a87-e5ea-429f-81ef-5121afb4832e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:03.742287 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3ef01a87-e5ea-429f-81ef-5121afb4832e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:03.753705 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3ef01a87-e5ea-429f-81ef-5121afb4832e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.180329 Feb 10 03:41:03.754580 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 314/635] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:03 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:04.013199 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0ab7d3a1-dbf4-4d46-bc61-b5f8b0dde119 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:04.014402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0ab7d3a1-dbf4-4d46-bc61-b5f8b0dde119 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:04.024420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0ab7d3a1-dbf4-4d46-bc61-b5f8b0dde119 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:04.024868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0ab7d3a1-dbf4-4d46-bc61-b5f8b0dde119 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:04.025649 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0ab7d3a1-dbf4-4d46-bc61-b5f8b0dde119 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:04.026112 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0ab7d3a1-dbf4-4d46-bc61-b5f8b0dde119 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:04.167398 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0ab7d3a1-dbf4-4d46-bc61-b5f8b0dde119 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:04.178026 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0ab7d3a1-dbf4-4d46-bc61-b5f8b0dde119 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.174713 Feb 10 03:41:04.178880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 322/636] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:04 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:04.361197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b6c778aa-efa3-4a94-8a1f-2d397aaad502 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:04.361814 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b6c778aa-efa3-4a94-8a1f-2d397aaad502 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:04.367969 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6c778aa-efa3-4a94-8a1f-2d397aaad502 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:04.368426 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6c778aa-efa3-4a94-8a1f-2d397aaad502 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:04.369207 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6c778aa-efa3-4a94-8a1f-2d397aaad502 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:04.370024 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6c778aa-efa3-4a94-8a1f-2d397aaad502 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:04.515850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b6c778aa-efa3-4a94-8a1f-2d397aaad502 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:04.521620 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b6c778aa-efa3-4a94-8a1f-2d397aaad502 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1358 microversion: 2.1 time: 0.164171 Feb 10 03:41:04.522187 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 315/637] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:04 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:04.773372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3361ebb3-0a05-4a75-b901-d94b786d79eb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:04.773966 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3361ebb3-0a05-4a75-b901-d94b786d79eb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:04.780504 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3361ebb3-0a05-4a75-b901-d94b786d79eb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:04.780943 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3361ebb3-0a05-4a75-b901-d94b786d79eb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:04.781711 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3361ebb3-0a05-4a75-b901-d94b786d79eb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:04.782132 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3361ebb3-0a05-4a75-b901-d94b786d79eb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:04.917726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3361ebb3-0a05-4a75-b901-d94b786d79eb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:04.926996 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3361ebb3-0a05-4a75-b901-d94b786d79eb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.157483 Feb 10 03:41:04.927550 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 323/638] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:04 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:05.198455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c4a4f089-7bfe-4096-b326-046b02fb81e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:05.199236 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c4a4f089-7bfe-4096-b326-046b02fb81e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:05.207140 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c4a4f089-7bfe-4096-b326-046b02fb81e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.207644 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c4a4f089-7bfe-4096-b326-046b02fb81e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.208507 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c4a4f089-7bfe-4096-b326-046b02fb81e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.208997 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c4a4f089-7bfe-4096-b326-046b02fb81e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.352108 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c4a4f089-7bfe-4096-b326-046b02fb81e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:05.360555 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c4a4f089-7bfe-4096-b326-046b02fb81e6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.167370 Feb 10 03:41:05.361140 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 316/639] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:05 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:05.538496 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f3f09ccf-1f33-4c39-b5dc-d3ed4b9e9e57 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:05.539225 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f3f09ccf-1f33-4c39-b5dc-d3ed4b9e9e57 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:05.545493 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f3f09ccf-1f33-4c39-b5dc-d3ed4b9e9e57 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.546019 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f3f09ccf-1f33-4c39-b5dc-d3ed4b9e9e57 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.547088 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f3f09ccf-1f33-4c39-b5dc-d3ed4b9e9e57 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.547415 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f3f09ccf-1f33-4c39-b5dc-d3ed4b9e9e57 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.686027 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f3f09ccf-1f33-4c39-b5dc-d3ed4b9e9e57 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:05.696183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f3f09ccf-1f33-4c39-b5dc-d3ed4b9e9e57 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1547 microversion: 2.1 time: 0.161345 Feb 10 03:41:05.696819 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 324/640] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:05 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:05.712570 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-55be49e8-aea7-471b-a470-384f0d8e02a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:05.713181 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-55be49e8-aea7-471b-a470-384f0d8e02a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:05.719308 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-55be49e8-aea7-471b-a470-384f0d8e02a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.719775 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-55be49e8-aea7-471b-a470-384f0d8e02a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.720545 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-55be49e8-aea7-471b-a470-384f0d8e02a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.720978 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-55be49e8-aea7-471b-a470-384f0d8e02a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.873592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-55be49e8-aea7-471b-a470-384f0d8e02a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:05.881722 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-55be49e8-aea7-471b-a470-384f0d8e02a8 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1547 microversion: 2.1 time: 0.172898 Feb 10 03:41:05.882293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 317/641] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:05 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:05.897259 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:05.900725 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:05.900725 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:41:05.901716 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:05.902446 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Searching by: {'deleted': False, 'project_id': 'f8d44d08ec564e94b99156087796bf3d'} {{(pid=127952) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 10 03:41:05.909658 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.910108 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.911009 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.911472 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.945289 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d9351f81-a073-4738-af8f-148a7dc1915f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:05.945885 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d9351f81-a073-4738-af8f-148a7dc1915f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:05.951877 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d9351f81-a073-4738-af8f-148a7dc1915f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.952323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d9351f81-a073-4738-af8f-148a7dc1915f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:05.953089 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d9351f81-a073-4738-af8f-148a7dc1915f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:05.953516 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d9351f81-a073-4738-af8f-148a7dc1915f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:06.000006 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.multi_cell_list [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127952) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 10 03:41:06.085484 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d9351f81-a073-4738-af8f-148a7dc1915f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:06.093366 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d9351f81-a073-4738-af8f-148a7dc1915f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.151818 Feb 10 03:41:06.093911 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 318/642] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:05 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:41:06.095474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f7273473-0691-417e-b1f2-1a88b2f8dc5e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201802 Feb 10 03:41:06.096043 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 325/643] 10.222.0.32 () {58 vars in 1124 bytes} [Thu Feb 10 03:41:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:06.105660 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6d77fb51-a003-48fb-a71f-22e8269e7ad5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:06.106258 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6d77fb51-a003-48fb-a71f-22e8269e7ad5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:06.117189 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d77fb51-a003-48fb-a71f-22e8269e7ad5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:06.119059 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d77fb51-a003-48fb-a71f-22e8269e7ad5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:06.119059 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d77fb51-a003-48fb-a71f-22e8269e7ad5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:06.119386 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d77fb51-a003-48fb-a71f-22e8269e7ad5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:06.272555 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6d77fb51-a003-48fb-a71f-22e8269e7ad5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:06.280475 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6d77fb51-a003-48fb-a71f-22e8269e7ad5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1547 microversion: 2.1 time: 0.178232 Feb 10 03:41:06.281044 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 319/644] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:06 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:41:06.377286 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c09c1b81-0544-4c3a-ae8c-3281592f0770 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:06.377899 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c09c1b81-0544-4c3a-ae8c-3281592f0770 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:06.383887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c09c1b81-0544-4c3a-ae8c-3281592f0770 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:06.384344 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c09c1b81-0544-4c3a-ae8c-3281592f0770 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:06.385126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c09c1b81-0544-4c3a-ae8c-3281592f0770 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:06.385566 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c09c1b81-0544-4c3a-ae8c-3281592f0770 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:06.539501 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c09c1b81-0544-4c3a-ae8c-3281592f0770 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:06.540458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c09c1b81-0544-4c3a-ae8c-3281592f0770 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.166911 Feb 10 03:41:06.548291 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 326/645] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:06 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:07.111166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-de5dd8be-9d0c-43ed-a393-3a24e2884da6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:07.111897 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-de5dd8be-9d0c-43ed-a393-3a24e2884da6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:07.118807 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-de5dd8be-9d0c-43ed-a393-3a24e2884da6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:07.119289 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-de5dd8be-9d0c-43ed-a393-3a24e2884da6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:07.120449 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-de5dd8be-9d0c-43ed-a393-3a24e2884da6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:07.120873 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-de5dd8be-9d0c-43ed-a393-3a24e2884da6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:07.258014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-de5dd8be-9d0c-43ed-a393-3a24e2884da6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:07.266194 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-de5dd8be-9d0c-43ed-a393-3a24e2884da6 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.159180 Feb 10 03:41:07.266793 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 320/646] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:07 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:07.568499 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-aabf8ebf-8bdd-44f0-b910-c3c2440df531 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:07.569683 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-aabf8ebf-8bdd-44f0-b910-c3c2440df531 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:07.580281 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aabf8ebf-8bdd-44f0-b910-c3c2440df531 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:07.581022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aabf8ebf-8bdd-44f0-b910-c3c2440df531 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:07.582293 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aabf8ebf-8bdd-44f0-b910-c3c2440df531 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:07.583104 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aabf8ebf-8bdd-44f0-b910-c3c2440df531 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:07.732577 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-aabf8ebf-8bdd-44f0-b910-c3c2440df531 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:07.741934 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-aabf8ebf-8bdd-44f0-b910-c3c2440df531 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.179607 Feb 10 03:41:07.742580 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 327/647] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:07 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:07.795558 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-649ee937-2efa-412f-add0-7cd03a2baabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3e2e2cd-c56f-4a5c-8787-b451ffc383da"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:07.796666 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-649ee937-2efa-412f-add0-7cd03a2baabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:07.802584 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-649ee937-2efa-412f-add0-7cd03a2baabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:07.803075 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-649ee937-2efa-412f-add0-7cd03a2baabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:07.803849 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-649ee937-2efa-412f-add0-7cd03a2baabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:07.804284 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-649ee937-2efa-412f-add0-7cd03a2baabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:08.055810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-649ee937-2efa-412f-add0-7cd03a2baabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "POST /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263928 Feb 10 03:41:08.056561 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 321/648] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:41:07 2022] POST /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:08.284185 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-01d4bdbc-ba75-4c48-98ee-92f41fdd1cf8 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:08.284876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-01d4bdbc-ba75-4c48-98ee-92f41fdd1cf8 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:08.291583 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-01d4bdbc-ba75-4c48-98ee-92f41fdd1cf8 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:08.292050 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-01d4bdbc-ba75-4c48-98ee-92f41fdd1cf8 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:08.293015 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-01d4bdbc-ba75-4c48-98ee-92f41fdd1cf8 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:08.293445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-01d4bdbc-ba75-4c48-98ee-92f41fdd1cf8 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:08.438432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-01d4bdbc-ba75-4c48-98ee-92f41fdd1cf8 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:08.446194 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-01d4bdbc-ba75-4c48-98ee-92f41fdd1cf8 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.165996 Feb 10 03:41:08.446798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 328/649] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:08 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:08.760949 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0010ff1e-a68d-417a-a9af-e3acb9b6b137 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:08.762186 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0010ff1e-a68d-417a-a9af-e3acb9b6b137 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:08.769124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0010ff1e-a68d-417a-a9af-e3acb9b6b137 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:08.769863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0010ff1e-a68d-417a-a9af-e3acb9b6b137 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:08.772325 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0010ff1e-a68d-417a-a9af-e3acb9b6b137 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:08.772325 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0010ff1e-a68d-417a-a9af-e3acb9b6b137 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:08.989663 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0010ff1e-a68d-417a-a9af-e3acb9b6b137 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:08.999928 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0010ff1e-a68d-417a-a9af-e3acb9b6b137 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.243598 Feb 10 03:41:09.000879 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 322/650] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:08 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:09.217282 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1e5840ad-280f-480e-a88c-f3d9f513db05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:09.217772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1e5840ad-280f-480e-a88c-f3d9f513db05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:09.224295 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1e5840ad-280f-480e-a88c-f3d9f513db05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:09.224741 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1e5840ad-280f-480e-a88c-f3d9f513db05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:09.225519 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1e5840ad-280f-480e-a88c-f3d9f513db05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:09.225953 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1e5840ad-280f-480e-a88c-f3d9f513db05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:09.255545 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1e5840ad-280f-480e-a88c-f3d9f513db05 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments/b61308dd-920e-444f-b40a-2b707c8d1691" status: 200 len: 194 microversion: 2.20 time: 0.041915 Feb 10 03:41:09.256117 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 329/651] 10.222.0.32 () {60 vars in 1453 bytes} [Thu Feb 10 03:41:09 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments/b61308dd-920e-444f-b40a-2b707c8d1691 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:41:09.318023 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b849be5c-64fa-4136-8040-6ae72cd72e21 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:09.318542 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b849be5c-64fa-4136-8040-6ae72cd72e21 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:09.325118 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b849be5c-64fa-4136-8040-6ae72cd72e21 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:09.325566 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b849be5c-64fa-4136-8040-6ae72cd72e21 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:09.326350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b849be5c-64fa-4136-8040-6ae72cd72e21 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:09.326837 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b849be5c-64fa-4136-8040-6ae72cd72e21 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:09.406398 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-b849be5c-64fa-4136-8040-6ae72cd72e21 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lazy-loading 'services' on Instance uuid d302b3d4-6282-4fbe-a4c4-248881ee8f51 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:41:09.464428 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3145ffe2-e3c3-4168-847c-3f8bd6eab3d4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:09.465138 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3145ffe2-e3c3-4168-847c-3f8bd6eab3d4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:09.471949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3145ffe2-e3c3-4168-847c-3f8bd6eab3d4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:09.472395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3145ffe2-e3c3-4168-847c-3f8bd6eab3d4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:09.473227 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3145ffe2-e3c3-4168-847c-3f8bd6eab3d4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:09.473821 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3145ffe2-e3c3-4168-847c-3f8bd6eab3d4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:09.475767 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b849be5c-64fa-4136-8040-6ae72cd72e21 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments/b61308dd-920e-444f-b40a-2b707c8d1691" status: 202 len: 0 microversion: 2.20 time: 0.161379 Feb 10 03:41:09.476694 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 323/652] 10.222.0.32 () {60 vars in 1456 bytes} [Thu Feb 10 03:41:09 2022] DELETE /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments/b61308dd-920e-444f-b40a-2b707c8d1691 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 10 03:41:09.485436 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-440f3ec2-f032-40ef-b7ca-7ad8fd52996d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:09.486492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-440f3ec2-f032-40ef-b7ca-7ad8fd52996d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:09.493819 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-440f3ec2-f032-40ef-b7ca-7ad8fd52996d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:09.494907 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-440f3ec2-f032-40ef-b7ca-7ad8fd52996d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:09.495879 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-440f3ec2-f032-40ef-b7ca-7ad8fd52996d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:09.496466 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-440f3ec2-f032-40ef-b7ca-7ad8fd52996d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:09.535459 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-440f3ec2-f032-40ef-b7ca-7ad8fd52996d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054159 Feb 10 03:41:09.536135 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 324/653] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Feb 10 03:41:09 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:41:09.627162 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3145ffe2-e3c3-4168-847c-3f8bd6eab3d4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:09.634945 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3145ffe2-e3c3-4168-847c-3f8bd6eab3d4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.174905 Feb 10 03:41:09.635510 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 330/654] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:09 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:41:10.017225 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d945193e-6ccc-46c2-9bd0-640c48fb902c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:10.017846 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d945193e-6ccc-46c2-9bd0-640c48fb902c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:10.028591 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d945193e-6ccc-46c2-9bd0-640c48fb902c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:10.029050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d945193e-6ccc-46c2-9bd0-640c48fb902c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:10.029877 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d945193e-6ccc-46c2-9bd0-640c48fb902c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:10.030314 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d945193e-6ccc-46c2-9bd0-640c48fb902c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:10.171945 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d945193e-6ccc-46c2-9bd0-640c48fb902c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:10.179864 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d945193e-6ccc-46c2-9bd0-640c48fb902c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1567 microversion: 2.1 time: 0.166375 Feb 10 03:41:10.180439 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 325/655] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:10 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:10.547501 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6137ce3f-802f-4512-9ff7-a89fd12e7413 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:10.548601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6137ce3f-802f-4512-9ff7-a89fd12e7413 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:10.555484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6137ce3f-802f-4512-9ff7-a89fd12e7413 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:10.555918 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6137ce3f-802f-4512-9ff7-a89fd12e7413 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:10.557025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6137ce3f-802f-4512-9ff7-a89fd12e7413 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:10.557462 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6137ce3f-802f-4512-9ff7-a89fd12e7413 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:10.589274 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6137ce3f-802f-4512-9ff7-a89fd12e7413 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045755 Feb 10 03:41:10.589872 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 331/656] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Feb 10 03:41:10 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:41:10.651784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a45645a5-bea5-4323-b74a-1878326a722f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:10.652414 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a45645a5-bea5-4323-b74a-1878326a722f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:10.658406 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a45645a5-bea5-4323-b74a-1878326a722f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:10.658902 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a45645a5-bea5-4323-b74a-1878326a722f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:10.659697 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a45645a5-bea5-4323-b74a-1878326a722f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:10.660137 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a45645a5-bea5-4323-b74a-1878326a722f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:10.794968 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a45645a5-bea5-4323-b74a-1878326a722f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:10.802790 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a45645a5-bea5-4323-b74a-1878326a722f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.154740 Feb 10 03:41:10.803614 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 326/657] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:10 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:11.198534 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-bfb3b8b9-c9ba-43b1-aea5-ab0ed4675303 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:11.199223 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-bfb3b8b9-c9ba-43b1-aea5-ab0ed4675303 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:11.205059 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bfb3b8b9-c9ba-43b1-aea5-ab0ed4675303 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.205517 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bfb3b8b9-c9ba-43b1-aea5-ab0ed4675303 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.206469 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bfb3b8b9-c9ba-43b1-aea5-ab0ed4675303 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.206976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bfb3b8b9-c9ba-43b1-aea5-ab0ed4675303 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.344740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-bfb3b8b9-c9ba-43b1-aea5-ab0ed4675303 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:11.353442 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-bfb3b8b9-c9ba-43b1-aea5-ab0ed4675303 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1547 microversion: 2.1 time: 0.159605 Feb 10 03:41:11.354016 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 332/658] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:11 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:11.375655 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:11.376188 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:11.382844 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.383293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.384103 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.384611 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.464258 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] HTTP exception thrown: Cannot 'detach_volume' instance 699b7ed3-80f5-47d0-bcec-6801073102d6 while it is in vm_state rescued Feb 10 03:41:11.464854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Returning 409 to user: Cannot 'detach_volume' instance 699b7ed3-80f5-47d0-bcec-6801073102d6 while it is in vm_state rescued {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:41:11.465687 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-461ddbbb-d0da-4439-829e-dc82793f9266 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "DELETE /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments/5374d800-d3db-4d91-9c6f-b09e1ed42134" status: 409 len: 152 microversion: 2.1 time: 0.093998 Feb 10 03:41:11.466212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 327/659] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:41:11 2022] DELETE /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments/5374d800-d3db-4d91-9c6f-b09e1ed42134 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 10 03:41:11.474974 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4ae32bcf-d336-486b-82bd-caef8f27b099 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:11.475720 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4ae32bcf-d336-486b-82bd-caef8f27b099 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:11.483496 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ae32bcf-d336-486b-82bd-caef8f27b099 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.484159 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ae32bcf-d336-486b-82bd-caef8f27b099 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.485106 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ae32bcf-d336-486b-82bd-caef8f27b099 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.485706 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ae32bcf-d336-486b-82bd-caef8f27b099 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.553698 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4ae32bcf-d336-486b-82bd-caef8f27b099 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/action" status: 202 len: 0 microversion: 2.1 time: 0.082231 Feb 10 03:41:11.555454 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 333/660] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:41:11 2022] POST /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 10 03:41:11.576471 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fc59b085-ed2a-4b59-8102-087879dcd471 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:11.581041 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fc59b085-ed2a-4b59-8102-087879dcd471 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:11.584332 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fc59b085-ed2a-4b59-8102-087879dcd471 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.584861 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fc59b085-ed2a-4b59-8102-087879dcd471 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.585695 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fc59b085-ed2a-4b59-8102-087879dcd471 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.586188 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fc59b085-ed2a-4b59-8102-087879dcd471 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.601759 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d86a9fa4-3fb4-4fe1-a978-b8bfbc911c54 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:11.602810 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d86a9fa4-3fb4-4fe1-a978-b8bfbc911c54 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:11.609147 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d86a9fa4-3fb4-4fe1-a978-b8bfbc911c54 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.610218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d86a9fa4-3fb4-4fe1-a978-b8bfbc911c54 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.611061 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d86a9fa4-3fb4-4fe1-a978-b8bfbc911c54 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.611507 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d86a9fa4-3fb4-4fe1-a978-b8bfbc911c54 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.655328 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d86a9fa4-3fb4-4fe1-a978-b8bfbc911c54 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057739 Feb 10 03:41:11.656751 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 334/661] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Feb 10 03:41:11 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:41:11.735899 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fc59b085-ed2a-4b59-8102-087879dcd471 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:11.744062 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fc59b085-ed2a-4b59-8102-087879dcd471 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1555 microversion: 2.1 time: 0.172760 Feb 10 03:41:11.745013 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 328/662] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:11 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:11.819952 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a4183547-5005-4eef-9d69-660ccee84002 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:11.820558 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a4183547-5005-4eef-9d69-660ccee84002 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:11.827980 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a4183547-5005-4eef-9d69-660ccee84002 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.828852 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a4183547-5005-4eef-9d69-660ccee84002 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.830114 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a4183547-5005-4eef-9d69-660ccee84002 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:11.830628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a4183547-5005-4eef-9d69-660ccee84002 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:11.970322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a4183547-5005-4eef-9d69-660ccee84002 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:11.977879 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a4183547-5005-4eef-9d69-660ccee84002 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.161758 Feb 10 03:41:11.978569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 335/663] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:11 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:12.667927 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-eb9fb18e-1ff1-422f-b18c-ade63a81fbac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:12.668917 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-eb9fb18e-1ff1-422f-b18c-ade63a81fbac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:12.675870 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb9fb18e-1ff1-422f-b18c-ade63a81fbac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:12.675870 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb9fb18e-1ff1-422f-b18c-ade63a81fbac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:12.676604 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb9fb18e-1ff1-422f-b18c-ade63a81fbac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:12.677042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb9fb18e-1ff1-422f-b18c-ade63a81fbac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:12.707732 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-eb9fb18e-1ff1-422f-b18c-ade63a81fbac tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043808 Feb 10 03:41:12.708526 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 329/664] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Feb 10 03:41:12 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:41:12.761884 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d8b415bb-41e6-4e54-bfd2-a8cf27ffb10d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:12.762586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d8b415bb-41e6-4e54-bfd2-a8cf27ffb10d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:12.768934 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d8b415bb-41e6-4e54-bfd2-a8cf27ffb10d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:12.769386 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d8b415bb-41e6-4e54-bfd2-a8cf27ffb10d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:12.770253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d8b415bb-41e6-4e54-bfd2-a8cf27ffb10d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:12.770765 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d8b415bb-41e6-4e54-bfd2-a8cf27ffb10d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:12.910810 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d8b415bb-41e6-4e54-bfd2-a8cf27ffb10d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:12.918963 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d8b415bb-41e6-4e54-bfd2-a8cf27ffb10d tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1555 microversion: 2.1 time: 0.160934 Feb 10 03:41:12.919657 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 336/665] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:12 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:12.995732 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-29faaa50-bdbe-420b-a2e4-f510b3b8b0ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:12.996404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-29faaa50-bdbe-420b-a2e4-f510b3b8b0ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:13.002688 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29faaa50-bdbe-420b-a2e4-f510b3b8b0ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:13.003171 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29faaa50-bdbe-420b-a2e4-f510b3b8b0ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:13.004806 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29faaa50-bdbe-420b-a2e4-f510b3b8b0ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:13.004806 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29faaa50-bdbe-420b-a2e4-f510b3b8b0ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:13.145275 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-29faaa50-bdbe-420b-a2e4-f510b3b8b0ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:13.153004 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-29faaa50-bdbe-420b-a2e4-f510b3b8b0ae tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1676 microversion: 2.1 time: 0.161885 Feb 10 03:41:13.153553 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 330/666] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:12 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:13.720359 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d7eb0deb-b9d4-4391-8d10-11e77999900e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:13.721272 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d7eb0deb-b9d4-4391-8d10-11e77999900e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:13.727752 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7eb0deb-b9d4-4391-8d10-11e77999900e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:13.728202 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7eb0deb-b9d4-4391-8d10-11e77999900e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:13.728982 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7eb0deb-b9d4-4391-8d10-11e77999900e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:13.729415 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7eb0deb-b9d4-4391-8d10-11e77999900e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:13.759608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d7eb0deb-b9d4-4391-8d10-11e77999900e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043139 Feb 10 03:41:13.760162 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 337/667] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Feb 10 03:41:13 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:41:13.938502 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-79a806dc-fca8-4c4c-8003-febfc11ed614 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:13.939239 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-79a806dc-fca8-4c4c-8003-febfc11ed614 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:13.947237 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79a806dc-fca8-4c4c-8003-febfc11ed614 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:13.947794 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79a806dc-fca8-4c4c-8003-febfc11ed614 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:13.948749 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79a806dc-fca8-4c4c-8003-febfc11ed614 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:13.949189 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79a806dc-fca8-4c4c-8003-febfc11ed614 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:14.098074 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-79a806dc-fca8-4c4c-8003-febfc11ed614 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:14.107202 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-79a806dc-fca8-4c4c-8003-febfc11ed614 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1555 microversion: 2.1 time: 0.173613 Feb 10 03:41:14.107765 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 331/668] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:13 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:14.169979 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-99387684-ab75-4e2c-b61a-63d2076b7b89 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:14.170586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-99387684-ab75-4e2c-b61a-63d2076b7b89 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:14.177234 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-99387684-ab75-4e2c-b61a-63d2076b7b89 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:14.177707 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-99387684-ab75-4e2c-b61a-63d2076b7b89 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:14.178493 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-99387684-ab75-4e2c-b61a-63d2076b7b89 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:14.178949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-99387684-ab75-4e2c-b61a-63d2076b7b89 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:14.315560 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-99387684-ab75-4e2c-b61a-63d2076b7b89 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:14.323990 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-99387684-ab75-4e2c-b61a-63d2076b7b89 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1653 microversion: 2.1 time: 0.157669 Feb 10 03:41:14.324557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 338/669] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:14 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1653 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:14.341328 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7904e6b3-ccb6-4f94-9ed7-9f09fe7f47a9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:14.348156 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7904e6b3-ccb6-4f94-9ed7-9f09fe7f47a9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:14.348838 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7904e6b3-ccb6-4f94-9ed7-9f09fe7f47a9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:14.377486 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7904e6b3-ccb6-4f94-9ed7-9f09fe7f47a9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Going to try to start instance {{(pid=127951) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 10 03:41:14.425190 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7904e6b3-ccb6-4f94-9ed7-9f09fe7f47a9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/action" status: 202 len: 0 microversion: 2.1 time: 0.088649 Feb 10 03:41:14.426696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 332/670] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:41:14 2022] POST /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 10 03:41:14.436550 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-13cd4fca-e6c5-4a1c-b508-e10418fc7a11 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:14.436550 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-13cd4fca-e6c5-4a1c-b508-e10418fc7a11 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:14.441058 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-13cd4fca-e6c5-4a1c-b508-e10418fc7a11 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:14.441563 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-13cd4fca-e6c5-4a1c-b508-e10418fc7a11 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:14.442591 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-13cd4fca-e6c5-4a1c-b508-e10418fc7a11 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:14.443050 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-13cd4fca-e6c5-4a1c-b508-e10418fc7a11 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:14.578967 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-13cd4fca-e6c5-4a1c-b508-e10418fc7a11 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:14.586584 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-13cd4fca-e6c5-4a1c-b508-e10418fc7a11 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1662 microversion: 2.1 time: 0.156417 Feb 10 03:41:14.587183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 339/671] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:14 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:14.771592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9afd3681-15f9-4948-b2b9-b84824912ba2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:14.772570 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9afd3681-15f9-4948-b2b9-b84824912ba2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:14.778977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9afd3681-15f9-4948-b2b9-b84824912ba2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:14.779685 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9afd3681-15f9-4948-b2b9-b84824912ba2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:14.780657 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9afd3681-15f9-4948-b2b9-b84824912ba2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:14.781094 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9afd3681-15f9-4948-b2b9-b84824912ba2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:14.816178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9afd3681-15f9-4948-b2b9-b84824912ba2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049067 Feb 10 03:41:14.816977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 333/672] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Feb 10 03:41:14 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:41:15.125526 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1a2577d3-a161-411c-816f-67fa8e64ae4f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:15.126132 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1a2577d3-a161-411c-816f-67fa8e64ae4f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:15.132245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a2577d3-a161-411c-816f-67fa8e64ae4f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.132688 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a2577d3-a161-411c-816f-67fa8e64ae4f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.133437 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a2577d3-a161-411c-816f-67fa8e64ae4f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.133905 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1a2577d3-a161-411c-816f-67fa8e64ae4f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.272943 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1a2577d3-a161-411c-816f-67fa8e64ae4f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:15.281247 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1a2577d3-a161-411c-816f-67fa8e64ae4f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1561 microversion: 2.1 time: 0.159491 Feb 10 03:41:15.281819 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 340/673] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:15 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:15.349789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6e708b0b-4b37-48bf-99b9-d73e57b7479b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:15.350363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6e708b0b-4b37-48bf-99b9-d73e57b7479b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:15.356805 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6e708b0b-4b37-48bf-99b9-d73e57b7479b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.357250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6e708b0b-4b37-48bf-99b9-d73e57b7479b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.358017 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6e708b0b-4b37-48bf-99b9-d73e57b7479b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.358447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6e708b0b-4b37-48bf-99b9-d73e57b7479b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.469869 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-6e708b0b-4b37-48bf-99b9-d73e57b7479b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lazy-loading 'services' on Instance uuid 699b7ed3-80f5-47d0-bcec-6801073102d6 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:41:15.593871 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6e708b0b-4b37-48bf-99b9-d73e57b7479b tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "DELETE /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments/5374d800-d3db-4d91-9c6f-b09e1ed42134" status: 202 len: 0 microversion: 2.1 time: 0.247669 Feb 10 03:41:15.594730 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 334/674] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:41:15 2022] DELETE /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments/5374d800-d3db-4d91-9c6f-b09e1ed42134 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:41:15.602861 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-bf1c846f-367c-4b2d-8f9b-5da6eb52e6a5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:15.603762 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-bf1c846f-367c-4b2d-8f9b-5da6eb52e6a5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:15.610583 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bf1c846f-367c-4b2d-8f9b-5da6eb52e6a5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.611245 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bf1c846f-367c-4b2d-8f9b-5da6eb52e6a5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.612364 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bf1c846f-367c-4b2d-8f9b-5da6eb52e6a5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.612888 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bf1c846f-367c-4b2d-8f9b-5da6eb52e6a5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.617939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2d616b4f-fbc5-41d2-bd85-004fe91ee428 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:15.620538 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-2d616b4f-fbc5-41d2-bd85-004fe91ee428 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:15.635114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2d616b4f-fbc5-41d2-bd85-004fe91ee428 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.635114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2d616b4f-fbc5-41d2-bd85-004fe91ee428 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.635114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2d616b4f-fbc5-41d2-bd85-004fe91ee428 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.635114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2d616b4f-fbc5-41d2-bd85-004fe91ee428 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.659305 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-bf1c846f-367c-4b2d-8f9b-5da6eb52e6a5 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060044 Feb 10 03:41:15.660432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 341/675] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:41:15 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:15.778142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4f84a156-6f01-4d36-a312-7c906cf0a0db tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:15.778956 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4f84a156-6f01-4d36-a312-7c906cf0a0db tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:15.788096 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4f84a156-6f01-4d36-a312-7c906cf0a0db tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.788802 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4f84a156-6f01-4d36-a312-7c906cf0a0db tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.790159 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4f84a156-6f01-4d36-a312-7c906cf0a0db tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.790612 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4f84a156-6f01-4d36-a312-7c906cf0a0db tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.826563 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2d616b4f-fbc5-41d2-bd85-004fe91ee428 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:15.836250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2d616b4f-fbc5-41d2-bd85-004fe91ee428 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1662 microversion: 2.1 time: 0.235765 Feb 10 03:41:15.836609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 335/676] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:15 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1662 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:41:15.855456 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-77297998-c2c4-46bf-a6c5-982efa69ff22 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:15.856614 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-77297998-c2c4-46bf-a6c5-982efa69ff22 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:15.862541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-77297998-c2c4-46bf-a6c5-982efa69ff22 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.863030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-77297998-c2c4-46bf-a6c5-982efa69ff22 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.863820 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-77297998-c2c4-46bf-a6c5-982efa69ff22 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.864436 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-77297998-c2c4-46bf-a6c5-982efa69ff22 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.903520 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-77297998-c2c4-46bf-a6c5-982efa69ff22 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056096 Feb 10 03:41:15.904414 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 336/677] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Feb 10 03:41:15 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:15.961600 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-79522a23-84ca-4437-a9cc-6f4f3497d714 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:15.962167 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-79522a23-84ca-4437-a9cc-6f4f3497d714 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:15.967448 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4f84a156-6f01-4d36-a312-7c906cf0a0db tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:15.968439 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79522a23-84ca-4437-a9cc-6f4f3497d714 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.968992 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79522a23-84ca-4437-a9cc-6f4f3497d714 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.969844 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79522a23-84ca-4437-a9cc-6f4f3497d714 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:15.970343 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-79522a23-84ca-4437-a9cc-6f4f3497d714 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:15.977137 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4f84a156-6f01-4d36-a312-7c906cf0a0db tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1593 microversion: 2.1 time: 0.203192 Feb 10 03:41:15.978079 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 342/678] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:15 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1593 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:41:16.003122 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-79522a23-84ca-4437-a9cc-6f4f3497d714 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Going to try to terminate instance {{(pid=127951) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:41:16.086177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-79522a23-84ca-4437-a9cc-6f4f3497d714 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 204 len: 0 microversion: 2.20 time: 0.127808 Feb 10 03:41:16.087127 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 337/679] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Feb 10 03:41:15 2022] DELETE /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 10 03:41:16.095038 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:16.095644 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:16.101432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:16.101875 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:16.102864 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:16.103299 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:16.271792 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:16.279932 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:16.281437 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:16.282598 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-61e86aec-5c38-4877-989a-a1a0b6ed8434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.191271 Feb 10 03:41:16.283201 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 343/680] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:16 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:16.671905 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-283ec36d-63f3-4ad6-a745-96be3d650524 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:16.672883 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-283ec36d-63f3-4ad6-a745-96be3d650524 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:16.679571 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-283ec36d-63f3-4ad6-a745-96be3d650524 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:16.680020 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-283ec36d-63f3-4ad6-a745-96be3d650524 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:16.680821 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-283ec36d-63f3-4ad6-a745-96be3d650524 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:16.681260 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-283ec36d-63f3-4ad6-a745-96be3d650524 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:16.712412 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-283ec36d-63f3-4ad6-a745-96be3d650524 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Feb 10 03:41:16.713353 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 338/681] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:41:16 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:16.853306 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6f33d2e4-f94e-4328-b399-ed568f84525f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:16.853962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6f33d2e4-f94e-4328-b399-ed568f84525f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:16.859911 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f33d2e4-f94e-4328-b399-ed568f84525f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:16.860367 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f33d2e4-f94e-4328-b399-ed568f84525f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:16.861147 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f33d2e4-f94e-4328-b399-ed568f84525f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:16.861587 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f33d2e4-f94e-4328-b399-ed568f84525f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:17.014166 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6f33d2e4-f94e-4328-b399-ed568f84525f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:17.022043 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6f33d2e4-f94e-4328-b399-ed568f84525f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1666 microversion: 2.1 time: 0.172440 Feb 10 03:41:17.022613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 344/682] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:16 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1666 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:17.301409 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:17.302021 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:17.308296 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:17.308744 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:17.309622 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:17.309937 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:17.471645 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:17.479928 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:17.481536 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:17.483044 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6549285c-d19b-41a3-863b-eeb3ccbf154a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.185565 Feb 10 03:41:17.483926 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 339/683] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:17 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:17.723590 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6a028119-c694-4195-bbfa-311a188a9270 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:17.724581 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6a028119-c694-4195-bbfa-311a188a9270 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:17.734271 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6a028119-c694-4195-bbfa-311a188a9270 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:17.734744 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6a028119-c694-4195-bbfa-311a188a9270 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:17.736130 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6a028119-c694-4195-bbfa-311a188a9270 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:17.736802 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6a028119-c694-4195-bbfa-311a188a9270 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:17.771788 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6a028119-c694-4195-bbfa-311a188a9270 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051851 Feb 10 03:41:17.772441 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 345/684] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:41:17 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:41:18.294279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-475207c1-d12c-466b-bee1-bbc2c49eaf69 req-4aa65df6-787b-47c2-948d-7e0bf739e1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a528a15b-6851-416c-9040-245fa3c93b88", "tag": "21a54a32-023a-446a-a188-568375c7704d"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:18.296966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:18.296966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:41:18.308220 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-475207c1-d12c-466b-bee1-bbc2c49eaf69 req-4aa65df6-787b-47c2-948d-7e0bf739e1d4 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:18.309493 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-475207c1-d12c-466b-bee1-bbc2c49eaf69 req-4aa65df6-787b-47c2-948d-7e0bf739e1d4 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:18.325612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-475207c1-d12c-466b-bee1-bbc2c49eaf69 req-4aa65df6-787b-47c2-948d-7e0bf739e1d4 service nova] Creating event network-changed:21a54a32-023a-446a-a188-568375c7704d for instance a528a15b-6851-416c-9040-245fa3c93b88 on hv-cinder-82806 Feb 10 03:41:18.331954 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-475207c1-d12c-466b-bee1-bbc2c49eaf69 req-4aa65df6-787b-47c2-948d-7e0bf739e1d4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044375 Feb 10 03:41:18.333332 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 340/685] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:18.501373 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:18.501983 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:18.509967 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:18.510508 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:18.516586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:18.517045 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:19.026735 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:19.037902 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:19.040518 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:19.041857 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b4abb752-0f8c-48e7-940a-0f0896f391d5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1722 microversion: 2.20 time: 0.544174 Feb 10 03:41:19.043324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 346/686] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:18 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1722 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:19.978173 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-93a2d1e5-d0e4-49ce-b14a-c9593b9c3fdf tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1178662493"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:19.978996 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-93a2d1e5-d0e4-49ce-b14a-c9593b9c3fdf tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:19.985426 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-93a2d1e5-d0e4-49ce-b14a-c9593b9c3fdf tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:19.985961 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-93a2d1e5-d0e4-49ce-b14a-c9593b9c3fdf tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:19.986834 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-93a2d1e5-d0e4-49ce-b14a-c9593b9c3fdf tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:19.987330 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-93a2d1e5-d0e4-49ce-b14a-c9593b9c3fdf tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.061572 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:20.062835 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:20.069648 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.070097 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.071082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.071665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.136323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.network.security_group_api [None req-93a2d1e5-d0e4-49ce-b14a-c9593b9c3fdf tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Adding security group d2dabf78-172c-46ea-90a9-a593f4fddf86 to port 21a54a32-023a-446a-a188-568375c7704d Feb 10 03:41:20.210995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:20.219619 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:20.221142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:20.222321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-94b94c4d-f8de-443f-9225-8d75984d794c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 200 len: 1655 microversion: 2.20 time: 0.164483 Feb 10 03:41:20.223057 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 347/687] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:20 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:41:20.237599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e65818da-8183-4616-8541-4e15fe4d6e22 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:20.238093 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e65818da-8183-4616-8541-4e15fe4d6e22 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:20.256819 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e65818da-8183-4616-8541-4e15fe4d6e22 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.257204 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e65818da-8183-4616-8541-4e15fe4d6e22 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.258000 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e65818da-8183-4616-8541-4e15fe4d6e22 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.258432 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e65818da-8183-4616-8541-4e15fe4d6e22 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.307651 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e65818da-8183-4616-8541-4e15fe4d6e22 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:41:20.451345 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e65818da-8183-4616-8541-4e15fe4d6e22 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "DELETE /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 204 len: 0 microversion: 2.1 time: 0.225663 Feb 10 03:41:20.451996 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 348/688] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:41:20 2022] DELETE /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:41:20.471817 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-e12811ee-9f12-4ab0-93ec-8cc4425ff896 req-b545f2d3-f1e2-4587-872c-bc9629e26b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d302b3d4-6282-4fbe-a4c4-248881ee8f51", "name": "network-vif-deleted", "tag": "29a0a5b3-6729-4753-8ce5-55f51a8c9a2e"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:20.473647 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:20.473647 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:41:20.482024 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-e12811ee-9f12-4ab0-93ec-8cc4425ff896 req-b545f2d3-f1e2-4587-872c-bc9629e26b42 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.482924 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-e12811ee-9f12-4ab0-93ec-8cc4425ff896 req-b545f2d3-f1e2-4587-872c-bc9629e26b42 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.497002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-e12811ee-9f12-4ab0-93ec-8cc4425ff896 req-b545f2d3-f1e2-4587-872c-bc9629e26b42 service nova] Creating event network-vif-deleted:29a0a5b3-6729-4753-8ce5-55f51a8c9a2e for instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 on hv-cinder-82806 Feb 10 03:41:20.502414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-e12811ee-9f12-4ab0-93ec-8cc4425ff896 req-b545f2d3-f1e2-4587-872c-bc9629e26b42 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045628 Feb 10 03:41:20.510863 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 349/689] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:20.518844 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-22b01aa7-7ff0-42f4-82cd-258e1cd156ea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:20.519921 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-22b01aa7-7ff0-42f4-82cd-258e1cd156ea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:20.528755 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-22b01aa7-7ff0-42f4-82cd-258e1cd156ea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.529458 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-22b01aa7-7ff0-42f4-82cd-258e1cd156ea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.530472 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-22b01aa7-7ff0-42f4-82cd-258e1cd156ea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.531273 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-22b01aa7-7ff0-42f4-82cd-258e1cd156ea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.850974 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-93a2d1e5-d0e4-49ce-b14a-c9593b9c3fdf tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "POST /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/action" status: 202 len: 0 microversion: 2.1 time: 0.877634 Feb 10 03:41:20.853145 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 341/690] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:41:19 2022] POST /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/action => generated 0 bytes in 881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:41:20.859646 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b6ffc782-7296-4cd6-981c-6bca14878611 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:20.860497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b6ffc782-7296-4cd6-981c-6bca14878611 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:20.874202 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6ffc782-7296-4cd6-981c-6bca14878611 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.874924 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6ffc782-7296-4cd6-981c-6bca14878611 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.875876 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6ffc782-7296-4cd6-981c-6bca14878611 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.878142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b6ffc782-7296-4cd6-981c-6bca14878611 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.891419 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-22b01aa7-7ff0-42f4-82cd-258e1cd156ea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:20.899266 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-22b01aa7-7ff0-42f4-82cd-258e1cd156ea tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1507 microversion: 2.1 time: 0.386061 Feb 10 03:41:20.919271 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 350/691] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:20 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:20.937871 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-fe48b232-7677-4cf0-8252-0a4380d6e442 req-af444d74-0b6f-471c-a745-3aec5abc9f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a528a15b-6851-416c-9040-245fa3c93b88", "tag": "21a54a32-023a-446a-a188-568375c7704d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:20.942218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:20.942218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:41:20.962105 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-fe48b232-7677-4cf0-8252-0a4380d6e442 req-af444d74-0b6f-471c-a745-3aec5abc9f09 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:20.964168 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-fe48b232-7677-4cf0-8252-0a4380d6e442 req-af444d74-0b6f-471c-a745-3aec5abc9f09 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:20.989054 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-fe48b232-7677-4cf0-8252-0a4380d6e442 req-af444d74-0b6f-471c-a745-3aec5abc9f09 service nova] Creating event network-changed:21a54a32-023a-446a-a188-568375c7704d for instance a528a15b-6851-416c-9040-245fa3c93b88 on hv-cinder-82806 Feb 10 03:41:21.000397 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-fe48b232-7677-4cf0-8252-0a4380d6e442 req-af444d74-0b6f-471c-a745-3aec5abc9f09 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076596 Feb 10 03:41:21.008478 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 351/692] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:21.241728 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b6ffc782-7296-4cd6-981c-6bca14878611 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:21.248108 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:21.249745 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:21.252015 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b6ffc782-7296-4cd6-981c-6bca14878611 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1759 microversion: 2.1 time: 0.395938 Feb 10 03:41:21.252664 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 342/693] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:20 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1759 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:21.278787 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:21.279573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:21.280828 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:21.281380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:21.305969 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] HTTP exception thrown: Instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 could not be found. Feb 10 03:41:21.308304 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Returning 404 to user: Instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:41:21.311605 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b7772bfa-8401-4140-876a-be1c05b69248 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 404 len: 111 microversion: 2.20 time: 0.074474 Feb 10 03:41:21.312439 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 352/694] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:21 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:41:21.321469 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6f126a00-7e61-4890-a9bb-fc6a1a84e725 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '.version_select at 0x7fe95a341310>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:21.352312 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6f126a00-7e61-4890-a9bb-fc6a1a84e725 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-321031094" status: 204 len: 0 microversion: 2.20 time: 0.034633 Feb 10 03:41:21.359721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 343/695] 10.222.0.32 () {60 vars in 1258 bytes} [Thu Feb 10 03:41:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-321031094 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 10 03:41:21.931792 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-79a35e9a-c8a1-4708-804b-251c5a2ed30c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:21.932576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-79a35e9a-c8a1-4708-804b-251c5a2ed30c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:21.940701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79a35e9a-c8a1-4708-804b-251c5a2ed30c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:21.941158 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79a35e9a-c8a1-4708-804b-251c5a2ed30c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:21.945794 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79a35e9a-c8a1-4708-804b-251c5a2ed30c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:21.946443 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-79a35e9a-c8a1-4708-804b-251c5a2ed30c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:22.197302 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-79a35e9a-c8a1-4708-804b-251c5a2ed30c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:22.207892 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-79a35e9a-c8a1-4708-804b-251c5a2ed30c tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1507 microversion: 2.1 time: 0.278440 Feb 10 03:41:22.210982 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 353/696] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:21 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:22.478044 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-628650c5-0ef3-49c3-bc9a-cb3b66fa84b8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'create', calling method: .version_select at 0x7fe95a32ee50>, body: {"keypair": {"name": "tempest-keypair-44903931"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:22.493048 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-628650c5-0ef3-49c3-bc9a-cb3b66fa84b8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:41:22.497403 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-628650c5-0ef3-49c3-bc9a-cb3b66fa84b8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for user d637094d14264332b6a947fe1e5c0ad8 and project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:41:22.688377 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-628650c5-0ef3-49c3-bc9a-cb3b66fa84b8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:41:22.692646 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-628650c5-0ef3-49c3-bc9a-cb3b66fa84b8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for user d637094d14264332b6a947fe1e5c0ad8 and project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:41:22.706890 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-628650c5-0ef3-49c3-bc9a-cb3b66fa84b8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.232646 Feb 10 03:41:22.707503 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 344/697] 10.222.0.32 () {62 vars in 1198 bytes} [Thu Feb 10 03:41:22 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 10 03:41:23.226537 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1c392c4e-205b-4a7b-93c5-3a724b831565 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:23.227317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1c392c4e-205b-4a7b-93c5-3a724b831565 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:23.236115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c392c4e-205b-4a7b-93c5-3a724b831565 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:23.236665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c392c4e-205b-4a7b-93c5-3a724b831565 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:23.237371 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c392c4e-205b-4a7b-93c5-3a724b831565 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:23.237808 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1c392c4e-205b-4a7b-93c5-3a724b831565 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:23.394643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1c392c4e-205b-4a7b-93c5-3a724b831565 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:23.402191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1c392c4e-205b-4a7b-93c5-3a724b831565 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1507 microversion: 2.1 time: 0.179472 Feb 10 03:41:23.402985 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 354/698] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:23 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:24.228736 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-ace54883-ee5c-4979-a1a5-897619a63299 req-38a7a581-5e4b-4fb4-99fe-ef34f0da30bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b92fc0-cfd3-4eb0-a15e-5d0558d253a9", "name": "network-vif-deleted", "tag": "fafc4667-568b-4a5e-9472-26cc6a82e44a"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:24.230345 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:24.230345 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:41:24.238297 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-ace54883-ee5c-4979-a1a5-897619a63299 req-38a7a581-5e4b-4fb4-99fe-ef34f0da30bd service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:24.238784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-ace54883-ee5c-4979-a1a5-897619a63299 req-38a7a581-5e4b-4fb4-99fe-ef34f0da30bd service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:24.252739 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-ace54883-ee5c-4979-a1a5-897619a63299 req-38a7a581-5e4b-4fb4-99fe-ef34f0da30bd service nova] Creating event network-vif-deleted:fafc4667-568b-4a5e-9472-26cc6a82e44a for instance 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 on hv-cinder-82806 Feb 10 03:41:24.259146 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-ace54883-ee5c-4979-a1a5-897619a63299 req-38a7a581-5e4b-4fb4-99fe-ef34f0da30bd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035055 Feb 10 03:41:24.260497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 345/699] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:24.418889 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:24.420319 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:24.426855 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:24.427373 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:24.428216 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:24.428698 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:24.459353 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:24.460129 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:24.460718 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lazy-loading 'fault' on Instance uuid 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:41:24.474911 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-244505445", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2276b970-ba53-4cdf-8089-151cb82a4e87"}], "security_groups": [{"name": "tempest-securitygroup--1872318529"}], "key_name": "tempest-keypair-44903931", "user_data": "}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:24.506511 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:24.514039 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-879375ad-ffdb-48d4-a9ff-d4735fa5a4a6 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 200 len: 1310 microversion: 2.1 time: 0.099264 Feb 10 03:41:24.515004 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 355/700] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:24 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:24.584386 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] validate_networks() for [('2276b970-ba53-4cdf-8089-151cb82a4e87', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:41:24.969332 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:41:24.969750 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:41:24.970214 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:41:24.970783 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:41:24.971193 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:41:24.979904 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:24.980354 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:24.981372 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:24.981827 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:24.998697 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:41:25.003025 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Getting quotas for user d637094d14264332b6a947fe1e5c0ad8 and project 50e1249fa4204bf9ba3044c3c1260634. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:41:25.014843 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:41:25.017259 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:41:25.069323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3fb926b1-3e16-46f0-9bfe-0f25ad270b98 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.599389 Feb 10 03:41:25.070606 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 346/701] 10.222.0.32 () {62 vars in 1187 bytes} [Thu Feb 10 03:41:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 10 03:41:25.080151 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8acea04e-1126-4dd4-93cf-861ee51dfd43 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:25.080752 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8acea04e-1126-4dd4-93cf-861ee51dfd43 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:25.144153 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8acea04e-1126-4dd4-93cf-861ee51dfd43 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:25.151448 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8acea04e-1126-4dd4-93cf-861ee51dfd43 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:25.152957 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8acea04e-1126-4dd4-93cf-861ee51dfd43 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:25.154066 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8acea04e-1126-4dd4-93cf-861ee51dfd43 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1279 microversion: 2.20 time: 0.077637 Feb 10 03:41:25.155230 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 356/702] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:25 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1279 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:25.531103 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:25.531734 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:25.538142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:25.538587 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:25.539385 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:25.539825 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:25.557340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] HTTP exception thrown: Instance 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 could not be found. Feb 10 03:41:25.557934 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Returning 404 to user: Instance 77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:41:25.558802 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c6510a7e-e20f-4425-ae7e-58c20430f73e tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9" status: 404 len: 111 microversion: 2.1 time: 0.032007 Feb 10 03:41:25.559535 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 347/703] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:25 2022] GET /compute/v2.1/servers/77b92fc0-cfd3-4eb0-a15e-5d0558d253a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 10 03:41:25.567310 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-98fb5fe9-b083-4dd8-a0ec-168d46c6d356 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:25.568378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-98fb5fe9-b083-4dd8-a0ec-168d46c6d356 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:25.575670 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-98fb5fe9-b083-4dd8-a0ec-168d46c6d356 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:25.576119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-98fb5fe9-b083-4dd8-a0ec-168d46c6d356 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:25.576898 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-98fb5fe9-b083-4dd8-a0ec-168d46c6d356 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:25.577329 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-98fb5fe9-b083-4dd8-a0ec-168d46c6d356 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:25.601729 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-98fb5fe9-b083-4dd8-a0ec-168d46c6d356 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:41:25.679680 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-98fb5fe9-b083-4dd8-a0ec-168d46c6d356 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "DELETE /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 204 len: 0 microversion: 2.1 time: 0.115685 Feb 10 03:41:25.680327 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 357/704] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:41:25 2022] DELETE /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:41:25.690265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c6c3e103-1bed-41d0-9e43-99ccfce6c0cc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:25.691352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c6c3e103-1bed-41d0-9e43-99ccfce6c0cc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:25.701411 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c6c3e103-1bed-41d0-9e43-99ccfce6c0cc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:25.702788 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c6c3e103-1bed-41d0-9e43-99ccfce6c0cc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:25.704051 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c6c3e103-1bed-41d0-9e43-99ccfce6c0cc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:25.704677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c6c3e103-1bed-41d0-9e43-99ccfce6c0cc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:25.849229 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c6c3e103-1bed-41d0-9e43-99ccfce6c0cc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:25.856795 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c6c3e103-1bed-41d0-9e43-99ccfce6c0cc tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.171441 Feb 10 03:41:25.857325 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 348/705] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:25 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:26.173069 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:26.173848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:26.180250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:26.180778 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:26.181650 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:26.182077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:26.243441 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:26.251971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:26.253506 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:26.254607 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-50179fd9-b692-42fe-b4de-f397cac65142 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1331 microversion: 2.20 time: 0.085811 Feb 10 03:41:26.255157 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 358/706] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:26 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1331 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:26.873725 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dda02ee3-6320-4d7f-b0f0-2cbf7a887972 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:26.874342 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dda02ee3-6320-4d7f-b0f0-2cbf7a887972 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:26.881528 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dda02ee3-6320-4d7f-b0f0-2cbf7a887972 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:26.882022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dda02ee3-6320-4d7f-b0f0-2cbf7a887972 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:26.882884 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dda02ee3-6320-4d7f-b0f0-2cbf7a887972 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:26.883416 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dda02ee3-6320-4d7f-b0f0-2cbf7a887972 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:27.029929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dda02ee3-6320-4d7f-b0f0-2cbf7a887972 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:27.037728 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dda02ee3-6320-4d7f-b0f0-2cbf7a887972 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.168033 Feb 10 03:41:27.049238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 349/707] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:26 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:27.272978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:27.273672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:27.280720 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:27.281244 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:27.282086 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:27.282603 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:27.420321 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:27.428860 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:27.430368 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:27.431504 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-63827102-fc02-49d2-bf44-df2477f33ba8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.162324 Feb 10 03:41:27.432062 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 359/708] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:27 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:27.891939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-cf2e065c-c1dc-4727-bf1b-b886f5300d14 req-de9222fd-c7cb-45f2-be43-942ebcc55444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68175f5a-583d-43b3-a6f6-3b045303c1d1", "tag": "dd4ed260-10d2-4b11-ae4a-2e37c7f81db6"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:27.894555 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:27.894555 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:41:27.902490 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-cf2e065c-c1dc-4727-bf1b-b886f5300d14 req-de9222fd-c7cb-45f2-be43-942ebcc55444 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:27.903229 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-cf2e065c-c1dc-4727-bf1b-b886f5300d14 req-de9222fd-c7cb-45f2-be43-942ebcc55444 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:27.917930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-cf2e065c-c1dc-4727-bf1b-b886f5300d14 req-de9222fd-c7cb-45f2-be43-942ebcc55444 service nova] Creating event network-changed:dd4ed260-10d2-4b11-ae4a-2e37c7f81db6 for instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 on hv-cinder-82806 Feb 10 03:41:27.923853 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-cf2e065c-c1dc-4727-bf1b-b886f5300d14 req-de9222fd-c7cb-45f2-be43-942ebcc55444 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035438 Feb 10 03:41:27.927453 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 350/709] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:28.055313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-267a47d5-7a05-4038-b244-69e30c673993 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:28.055900 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-267a47d5-7a05-4038-b244-69e30c673993 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:28.062088 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-267a47d5-7a05-4038-b244-69e30c673993 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:28.062528 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-267a47d5-7a05-4038-b244-69e30c673993 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:28.063314 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-267a47d5-7a05-4038-b244-69e30c673993 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:28.063739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-267a47d5-7a05-4038-b244-69e30c673993 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:28.198030 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-267a47d5-7a05-4038-b244-69e30c673993 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:28.205706 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-267a47d5-7a05-4038-b244-69e30c673993 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.154225 Feb 10 03:41:28.206520 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 360/710] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:28 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:28.450212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:28.450836 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:28.457320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:28.457761 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:28.458525 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:28.458985 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:28.596105 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:28.603968 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:28.605441 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:28.606543 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ac4e0f7a-61fa-4ed6-adb1-167520bfcaa0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.160714 Feb 10 03:41:28.607133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 351/711] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:28 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:29.226602 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-37ae20ee-7fb4-4deb-9e01-3059c755b08a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:29.227598 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-37ae20ee-7fb4-4deb-9e01-3059c755b08a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:29.238392 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-37ae20ee-7fb4-4deb-9e01-3059c755b08a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:29.239254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-37ae20ee-7fb4-4deb-9e01-3059c755b08a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:29.240527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-37ae20ee-7fb4-4deb-9e01-3059c755b08a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:29.241289 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-37ae20ee-7fb4-4deb-9e01-3059c755b08a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:29.383122 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-37ae20ee-7fb4-4deb-9e01-3059c755b08a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:29.390914 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-37ae20ee-7fb4-4deb-9e01-3059c755b08a tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.170402 Feb 10 03:41:29.391490 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 361/712] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:29 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:29.629966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:29.631030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:29.639623 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:29.640078 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:29.640860 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:29.641299 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:29.783251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:29.791736 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:29.793226 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:29.794309 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3b59621f-20a2-41a0-847e-22be074443c7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.170769 Feb 10 03:41:29.794894 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 352/713] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:29 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:30.410708 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-089488ab-bfe9-4329-bd21-16634d0baf7f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:30.411562 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-089488ab-bfe9-4329-bd21-16634d0baf7f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:30.420007 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-089488ab-bfe9-4329-bd21-16634d0baf7f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:30.420459 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-089488ab-bfe9-4329-bd21-16634d0baf7f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:30.421251 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-089488ab-bfe9-4329-bd21-16634d0baf7f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:30.421684 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-089488ab-bfe9-4329-bd21-16634d0baf7f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:30.572803 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-089488ab-bfe9-4329-bd21-16634d0baf7f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:30.582566 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-089488ab-bfe9-4329-bd21-16634d0baf7f tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.177227 Feb 10 03:41:30.583213 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 362/714] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:30 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:30.818318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:30.818941 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:30.826123 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:30.826577 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:30.827391 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:30.827830 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:30.989872 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:30.999652 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:31.001153 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:31.002340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-27a57425-b82a-4fc2-a491-142eb3b78b95 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.187848 Feb 10 03:41:31.002927 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 353/715] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:30 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:31.603814 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ed1512cd-d318-4a87-a643-07a900c95e96 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:31.604740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ed1512cd-d318-4a87-a643-07a900c95e96 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:31.615398 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ed1512cd-d318-4a87-a643-07a900c95e96 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:31.616139 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ed1512cd-d318-4a87-a643-07a900c95e96 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:31.617423 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ed1512cd-d318-4a87-a643-07a900c95e96 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:31.618144 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ed1512cd-d318-4a87-a643-07a900c95e96 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:31.760953 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ed1512cd-d318-4a87-a643-07a900c95e96 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:31.773507 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ed1512cd-d318-4a87-a643-07a900c95e96 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1521 microversion: 2.1 time: 0.175771 Feb 10 03:41:31.774418 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 363/716] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:31 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:32.025014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:32.025865 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:32.036551 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:32.037308 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:32.038634 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:32.039413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:32.194603 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:32.203041 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:32.204553 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:32.205660 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f4553816-6609-4f58-9625-c0f1103fdb06 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.187001 Feb 10 03:41:32.206219 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 354/717] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:32 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:32.791533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-07abbcb0-ca17-4cf9-a88c-7a6bde4a18f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:32.792139 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-07abbcb0-ca17-4cf9-a88c-7a6bde4a18f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:32.798940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-07abbcb0-ca17-4cf9-a88c-7a6bde4a18f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:32.799380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-07abbcb0-ca17-4cf9-a88c-7a6bde4a18f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:32.800163 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-07abbcb0-ca17-4cf9-a88c-7a6bde4a18f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:32.800612 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-07abbcb0-ca17-4cf9-a88c-7a6bde4a18f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:32.812580 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-cfb54bac-e4ba-43bf-8c31-0d6b667b94be req-bf407600-46e1-497d-b5f1-15e9f2d6467a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "699b7ed3-80f5-47d0-bcec-6801073102d6", "name": "network-vif-deleted", "tag": "1de8a500-64d0-4173-8581-65530f888f8a"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:32.814402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:32.814402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:41:32.821758 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-cfb54bac-e4ba-43bf-8c31-0d6b667b94be req-bf407600-46e1-497d-b5f1-15e9f2d6467a service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:32.822200 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-cfb54bac-e4ba-43bf-8c31-0d6b667b94be req-bf407600-46e1-497d-b5f1-15e9f2d6467a service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:32.833775 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-cfb54bac-e4ba-43bf-8c31-0d6b667b94be req-bf407600-46e1-497d-b5f1-15e9f2d6467a service nova] Creating event network-vif-deleted:1de8a500-64d0-4173-8581-65530f888f8a for instance 699b7ed3-80f5-47d0-bcec-6801073102d6 on hv-cinder-82806 Feb 10 03:41:32.838594 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-cfb54bac-e4ba-43bf-8c31-0d6b667b94be req-bf407600-46e1-497d-b5f1-15e9f2d6467a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029782 Feb 10 03:41:32.839525 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 355/718] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:41:32.866148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-07abbcb0-ca17-4cf9-a88c-7a6bde4a18f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddab0c5f110c41eba9629f8020db02fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e0c095df64647bf339f0e8dcf8571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:32.874003 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-07abbcb0-ca17-4cf9-a88c-7a6bde4a18f3 tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 200 len: 1479 microversion: 2.1 time: 0.086147 Feb 10 03:41:32.874563 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 364/719] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:32 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 1479 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:33.226022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:33.226876 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:33.234076 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:33.234544 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:33.235423 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:33.235862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:33.377926 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:33.386177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:33.387893 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:33.389005 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dee77a12-0ce9-4ec4-98a0-757fb603cff8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.168698 Feb 10 03:41:33.390200 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 356/720] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:33 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:33.894637 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:33.895533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] [instance: 699b7ed3-80f5-47d0-bcec-6801073102d6] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:33.905708 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:33.906149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:33.906950 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:33.907372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:33.920758 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] HTTP exception thrown: Instance 699b7ed3-80f5-47d0-bcec-6801073102d6 could not be found. Feb 10 03:41:33.921319 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] Returning 404 to user: Instance 699b7ed3-80f5-47d0-bcec-6801073102d6 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:41:33.922100 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-fe2aa2f7-8b3d-4248-87ab-ef6bb545edba tempest-ServerRescueNegativeTestJSON-885213482 tempest-ServerRescueNegativeTestJSON-885213482-project] 10.222.0.32 "GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6" status: 404 len: 111 microversion: 2.1 time: 0.033727 Feb 10 03:41:33.922615 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 365/721] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:33 2022] GET /compute/v2.1/servers/699b7ed3-80f5-47d0-bcec-6801073102d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:41:34.410966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:34.411588 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:34.419696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:34.420140 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:34.420932 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:34.421370 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:34.561001 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:34.569252 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:34.570789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:34.571897 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-955809a0-ca3d-4359-bccd-bfec4f76a6e8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.167604 Feb 10 03:41:34.572474 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 357/722] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:34 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:35.133041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-f74ef623-be48-41e1-8a7a-146f075e4a27 req-8eb60f68-607b-4bca-8d1e-cbf5af2bcde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68175f5a-583d-43b3-a6f6-3b045303c1d1", "name": "network-vif-plugged", "status": "completed", "tag": "dd4ed260-10d2-4b11-ae4a-2e37c7f81db6"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:35.135047 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:35.135047 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:41:35.143716 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-f74ef623-be48-41e1-8a7a-146f075e4a27 req-8eb60f68-607b-4bca-8d1e-cbf5af2bcde2 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:35.144520 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-f74ef623-be48-41e1-8a7a-146f075e4a27 req-8eb60f68-607b-4bca-8d1e-cbf5af2bcde2 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:35.159828 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-f74ef623-be48-41e1-8a7a-146f075e4a27 req-8eb60f68-607b-4bca-8d1e-cbf5af2bcde2 service nova] Creating event network-vif-plugged:dd4ed260-10d2-4b11-ae4a-2e37c7f81db6 for instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 on hv-cinder-82806 Feb 10 03:41:35.165045 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-f74ef623-be48-41e1-8a7a-146f075e4a27 req-8eb60f68-607b-4bca-8d1e-cbf5af2bcde2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037871 Feb 10 03:41:35.166047 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 366/723] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:35.589634 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:35.590246 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:35.597480 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:35.597940 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:35.598756 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:35.599197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:35.738437 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:35.746639 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:35.748166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:35.749461 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6c5f24aa-3c9c-41d1-bd75-cd66595c9547 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.163746 Feb 10 03:41:35.750052 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 358/724] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:35 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:36.767929 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:36.768683 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:36.776534 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:36.777599 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:36.778691 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:36.779279 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:37.039672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:37.048481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:37.049954 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:37.051322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-83da4c55-0f6f-4121-b83b-9325aa275dcf tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1405 microversion: 2.20 time: 0.287585 Feb 10 03:41:37.054179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 367/725] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:36 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:38.069349 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:38.070096 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:38.076234 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:38.076686 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:38.077569 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:38.078366 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:38.464470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:38.472300 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:38.473809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:38.475124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e339b7e8-81f6-4d53-b5b0-f2ce2f2d8a6a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1597 microversion: 2.20 time: 0.409441 Feb 10 03:41:38.475774 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 359/726] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:38 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1597 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:38.493551 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-569d69bf-d33a-442b-a788-5ce6b62bc68a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:38.494074 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-569d69bf-d33a-442b-a788-5ce6b62bc68a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:38.501189 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-569d69bf-d33a-442b-a788-5ce6b62bc68a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:38.501717 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-569d69bf-d33a-442b-a788-5ce6b62bc68a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:38.502497 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-569d69bf-d33a-442b-a788-5ce6b62bc68a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:38.503085 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-569d69bf-d33a-442b-a788-5ce6b62bc68a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:38.586080 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-569d69bf-d33a-442b-a788-5ce6b62bc68a tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096334 Feb 10 03:41:38.586699 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 368/727] 10.222.0.32 () {60 vars in 1315 bytes} [Thu Feb 10 03:41:38 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:41:39.580431 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:39.581065 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:39.582813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-466de593-360e-42ab-bb5f-39217d6eaf71 req-ecbf8f9d-81f1-4afc-b003-fd64943a9201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68175f5a-583d-43b3-a6f6-3b045303c1d1", "tag": "dd4ed260-10d2-4b11-ae4a-2e37c7f81db6"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:39.584469 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:41:39.584469 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:41:39.588159 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:39.588691 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:39.589479 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:39.589911 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:39.591730 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-466de593-360e-42ab-bb5f-39217d6eaf71 req-ecbf8f9d-81f1-4afc-b003-fd64943a9201 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:39.592281 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-466de593-360e-42ab-bb5f-39217d6eaf71 req-ecbf8f9d-81f1-4afc-b003-fd64943a9201 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:39.603595 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-466de593-360e-42ab-bb5f-39217d6eaf71 req-ecbf8f9d-81f1-4afc-b003-fd64943a9201 service nova] Creating event network-changed:dd4ed260-10d2-4b11-ae4a-2e37c7f81db6 for instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 on hv-cinder-82806 Feb 10 03:41:39.608671 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-466de593-360e-42ab-bb5f-39217d6eaf71 req-ecbf8f9d-81f1-4afc-b003-fd64943a9201 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030136 Feb 10 03:41:39.609705 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 369/728] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:41:39.742405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:39.751342 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:39.752851 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:39.754225 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c733069c-8dc7-4cce-bc0c-a08e0fa0b22c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1597 microversion: 2.20 time: 0.177809 Feb 10 03:41:39.754807 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 360/729] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:39 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1597 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:40.778144 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:40.778803 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:40.785438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:40.785888 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:40.786697 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:40.787134 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:40.925569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:40.933712 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:40.935263 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:40.936533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1bfa1772-64e8-4ac5-8bb0-bf71f2f5fac0 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1715 microversion: 2.20 time: 0.165684 Feb 10 03:41:40.937062 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 370/730] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:41:40 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:41:40.955162 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-23ce5371-0702-43d6-94ba-eae5585bf0a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:40.955721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-23ce5371-0702-43d6-94ba-eae5585bf0a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:40.962343 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-23ce5371-0702-43d6-94ba-eae5585bf0a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:40.962813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-23ce5371-0702-43d6-94ba-eae5585bf0a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:40.963599 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-23ce5371-0702-43d6-94ba-eae5585bf0a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:40.964041 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-23ce5371-0702-43d6-94ba-eae5585bf0a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:40.986595 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-23ce5371-0702-43d6-94ba-eae5585bf0a7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/ips" status: 200 len: 151 microversion: 2.20 time: 0.035477 Feb 10 03:41:40.987194 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 361/731] 10.222.0.32 () {60 vars in 1288 bytes} [Thu Feb 10 03:41:40 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 10 03:41:45.707786 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d184d66f-a9bf-41ef-85c9-c5c19e766d8c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:41:45.708720 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d184d66f-a9bf-41ef-85c9-c5c19e766d8c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:45.715374 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d184d66f-a9bf-41ef-85c9-c5c19e766d8c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:45.715810 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d184d66f-a9bf-41ef-85c9-c5c19e766d8c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:45.716570 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d184d66f-a9bf-41ef-85c9-c5c19e766d8c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:45.717000 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d184d66f-a9bf-41ef-85c9-c5c19e766d8c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:45.797920 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d184d66f-a9bf-41ef-85c9-c5c19e766d8c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "POST /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/action" status: 202 len: 0 microversion: 2.1 time: 0.093655 Feb 10 03:41:45.798945 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 371/732] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:41:45 2022] POST /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:41:45.807050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6d1073da-487f-4556-9145-32254788666e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:45.807651 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6d1073da-487f-4556-9145-32254788666e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:45.814283 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d1073da-487f-4556-9145-32254788666e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:45.814770 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d1073da-487f-4556-9145-32254788666e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:45.815556 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d1073da-487f-4556-9145-32254788666e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:45.815994 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6d1073da-487f-4556-9145-32254788666e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:45.970502 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-6d1073da-487f-4556-9145-32254788666e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:45.978745 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6d1073da-487f-4556-9145-32254788666e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1751 microversion: 2.1 time: 0.175354 Feb 10 03:41:45.979529 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 362/733] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:45 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:47.002054 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4ec9f8d9-9e8e-436d-9df7-89055504ae44 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:47.003175 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4ec9f8d9-9e8e-436d-9df7-89055504ae44 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:47.014122 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ec9f8d9-9e8e-436d-9df7-89055504ae44 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:47.014972 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ec9f8d9-9e8e-436d-9df7-89055504ae44 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:47.016247 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ec9f8d9-9e8e-436d-9df7-89055504ae44 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:47.016968 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ec9f8d9-9e8e-436d-9df7-89055504ae44 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:47.174484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4ec9f8d9-9e8e-436d-9df7-89055504ae44 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:47.185998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4ec9f8d9-9e8e-436d-9df7-89055504ae44 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.190767 Feb 10 03:41:47.186705 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 372/734] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:46 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:48.205532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ef5c1e04-b1c7-42a7-ac9c-d9e37c837682 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:48.206141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ef5c1e04-b1c7-42a7-ac9c-d9e37c837682 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:48.212945 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e04-b1c7-42a7-ac9c-d9e37c837682 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:48.213400 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e04-b1c7-42a7-ac9c-d9e37c837682 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:48.214176 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e04-b1c7-42a7-ac9c-d9e37c837682 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:48.214609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ef5c1e04-b1c7-42a7-ac9c-d9e37c837682 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:48.373681 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ef5c1e04-b1c7-42a7-ac9c-d9e37c837682 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:48.382040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ef5c1e04-b1c7-42a7-ac9c-d9e37c837682 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.180246 Feb 10 03:41:48.382751 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 363/735] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:48 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:49.399523 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-67d364a7-820d-4500-887c-715294d07a45 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:49.400281 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-67d364a7-820d-4500-887c-715294d07a45 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:49.406968 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-67d364a7-820d-4500-887c-715294d07a45 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:49.407419 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-67d364a7-820d-4500-887c-715294d07a45 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:49.408200 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-67d364a7-820d-4500-887c-715294d07a45 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:49.408634 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-67d364a7-820d-4500-887c-715294d07a45 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:49.616883 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-67d364a7-820d-4500-887c-715294d07a45 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:49.626233 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-67d364a7-820d-4500-887c-715294d07a45 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.230483 Feb 10 03:41:49.626940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 373/736] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:49 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:50.643638 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4ffd0d91-26de-47e7-94ae-cb940d0443cb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:50.644203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4ffd0d91-26de-47e7-94ae-cb940d0443cb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:50.650951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4ffd0d91-26de-47e7-94ae-cb940d0443cb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:50.651512 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4ffd0d91-26de-47e7-94ae-cb940d0443cb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:50.652301 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4ffd0d91-26de-47e7-94ae-cb940d0443cb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:50.652768 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4ffd0d91-26de-47e7-94ae-cb940d0443cb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:50.818141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4ffd0d91-26de-47e7-94ae-cb940d0443cb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:50.827151 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4ffd0d91-26de-47e7-94ae-cb940d0443cb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.187189 Feb 10 03:41:50.827703 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 364/737] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:50 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:51.847261 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d039b68f-dd74-4f9e-897d-1fc318e571f9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:51.848294 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d039b68f-dd74-4f9e-897d-1fc318e571f9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:51.858072 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d039b68f-dd74-4f9e-897d-1fc318e571f9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:51.858753 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d039b68f-dd74-4f9e-897d-1fc318e571f9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:51.860017 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d039b68f-dd74-4f9e-897d-1fc318e571f9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:51.860709 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d039b68f-dd74-4f9e-897d-1fc318e571f9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:52.031903 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d039b68f-dd74-4f9e-897d-1fc318e571f9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:52.039971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d039b68f-dd74-4f9e-897d-1fc318e571f9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.198472 Feb 10 03:41:52.041110 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 374/738] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:51 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:53.057394 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-38429607-bc42-4153-b010-aaa9a8519bc9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:53.058202 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-38429607-bc42-4153-b010-aaa9a8519bc9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:53.064874 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-38429607-bc42-4153-b010-aaa9a8519bc9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:53.065331 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-38429607-bc42-4153-b010-aaa9a8519bc9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:53.066124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-38429607-bc42-4153-b010-aaa9a8519bc9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:53.066581 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-38429607-bc42-4153-b010-aaa9a8519bc9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:53.214481 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-38429607-bc42-4153-b010-aaa9a8519bc9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:53.223674 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-38429607-bc42-4153-b010-aaa9a8519bc9 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.169961 Feb 10 03:41:53.224270 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 365/739] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:53 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:54.245121 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-af3b4308-dbf7-4f1b-b85b-494b81f864c0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:54.246055 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-af3b4308-dbf7-4f1b-b85b-494b81f864c0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:54.255872 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af3b4308-dbf7-4f1b-b85b-494b81f864c0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:54.256319 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af3b4308-dbf7-4f1b-b85b-494b81f864c0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:54.257094 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af3b4308-dbf7-4f1b-b85b-494b81f864c0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:54.257525 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af3b4308-dbf7-4f1b-b85b-494b81f864c0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:54.412306 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-af3b4308-dbf7-4f1b-b85b-494b81f864c0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:54.420569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-af3b4308-dbf7-4f1b-b85b-494b81f864c0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.182084 Feb 10 03:41:54.421118 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 375/740] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:54 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:55.441490 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-81d3a71f-0fc8-42e3-9fd5-1705d8a063c3 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:55.442486 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-81d3a71f-0fc8-42e3-9fd5-1705d8a063c3 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:55.453208 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-81d3a71f-0fc8-42e3-9fd5-1705d8a063c3 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:55.453964 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-81d3a71f-0fc8-42e3-9fd5-1705d8a063c3 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:55.455321 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-81d3a71f-0fc8-42e3-9fd5-1705d8a063c3 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:55.456056 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-81d3a71f-0fc8-42e3-9fd5-1705d8a063c3 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:55.606862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-81d3a71f-0fc8-42e3-9fd5-1705d8a063c3 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:55.615034 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-81d3a71f-0fc8-42e3-9fd5-1705d8a063c3 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.179743 Feb 10 03:41:55.615609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 366/741] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:55 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:56.636394 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-29abb763-2026-44de-8683-2cf1fbcd36da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:56.637385 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-29abb763-2026-44de-8683-2cf1fbcd36da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:56.648041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-29abb763-2026-44de-8683-2cf1fbcd36da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:56.648780 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-29abb763-2026-44de-8683-2cf1fbcd36da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:56.650112 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-29abb763-2026-44de-8683-2cf1fbcd36da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:56.650973 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-29abb763-2026-44de-8683-2cf1fbcd36da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:56.811752 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-29abb763-2026-44de-8683-2cf1fbcd36da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:56.823851 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-29abb763-2026-44de-8683-2cf1fbcd36da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.193388 Feb 10 03:41:56.824592 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 376/742] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:56 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:57.847872 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3f309275-7c3b-48f6-8252-d95f4d933d28 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:57.848455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3f309275-7c3b-48f6-8252-d95f4d933d28 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:57.854960 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3f309275-7c3b-48f6-8252-d95f4d933d28 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:57.855413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3f309275-7c3b-48f6-8252-d95f4d933d28 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:57.856195 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3f309275-7c3b-48f6-8252-d95f4d933d28 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:57.856636 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3f309275-7c3b-48f6-8252-d95f4d933d28 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:58.013504 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3f309275-7c3b-48f6-8252-d95f4d933d28 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:58.021493 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3f309275-7c3b-48f6-8252-d95f4d933d28 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.180399 Feb 10 03:41:58.022347 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 367/743] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:57 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:41:59.042908 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ee9109f7-ec29-462f-b281-0fe54601cabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:41:59.043969 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ee9109f7-ec29-462f-b281-0fe54601cabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:41:59.054001 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ee9109f7-ec29-462f-b281-0fe54601cabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:59.054454 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ee9109f7-ec29-462f-b281-0fe54601cabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:59.055276 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ee9109f7-ec29-462f-b281-0fe54601cabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:41:59.055711 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ee9109f7-ec29-462f-b281-0fe54601cabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:41:59.204446 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ee9109f7-ec29-462f-b281-0fe54601cabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:41:59.212792 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ee9109f7-ec29-462f-b281-0fe54601cabb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.176087 Feb 10 03:41:59.213376 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 377/744] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:41:59 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:00.230602 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bf8a3a52-3508-427b-914b-8469b83766eb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:00.231270 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bf8a3a52-3508-427b-914b-8469b83766eb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:00.238054 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf8a3a52-3508-427b-914b-8469b83766eb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:00.238507 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf8a3a52-3508-427b-914b-8469b83766eb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:00.239333 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf8a3a52-3508-427b-914b-8469b83766eb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:00.239792 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf8a3a52-3508-427b-914b-8469b83766eb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:00.397557 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bf8a3a52-3508-427b-914b-8469b83766eb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:00.409250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bf8a3a52-3508-427b-914b-8469b83766eb tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.182265 Feb 10 03:42:00.409915 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 368/745] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:00 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:00.465435 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5d36ff63-45c0-470d-a3a2-50de32bfe5c1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:00.466481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5d36ff63-45c0-470d-a3a2-50de32bfe5c1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:00.473243 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d36ff63-45c0-470d-a3a2-50de32bfe5c1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:00.473771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d36ff63-45c0-470d-a3a2-50de32bfe5c1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:00.474546 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d36ff63-45c0-470d-a3a2-50de32bfe5c1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:00.475024 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5d36ff63-45c0-470d-a3a2-50de32bfe5c1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:00.504583 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5d36ff63-45c0-470d-a3a2-50de32bfe5c1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042951 Feb 10 03:42:00.505146 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 378/746] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:42:00 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:42:00.718562 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c22a9af1-1076-499c-9413-5d8b183d67d0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:00.719084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c22a9af1-1076-499c-9413-5d8b183d67d0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:00.725180 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c22a9af1-1076-499c-9413-5d8b183d67d0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:00.725669 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c22a9af1-1076-499c-9413-5d8b183d67d0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:00.726441 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c22a9af1-1076-499c-9413-5d8b183d67d0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:00.726906 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c22a9af1-1076-499c-9413-5d8b183d67d0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:00.752676 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c22a9af1-1076-499c-9413-5d8b183d67d0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Going to try to terminate instance {{(pid=127951) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:42:00.829663 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c22a9af1-1076-499c-9413-5d8b183d67d0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 204 len: 0 microversion: 2.1 time: 0.114448 Feb 10 03:42:00.830628 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 369/747] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:42:00 2022] DELETE /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:42:00.839339 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b8e5b03e-7e2b-4d33-8b09-252c21ecbb0a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:00.839928 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b8e5b03e-7e2b-4d33-8b09-252c21ecbb0a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:00.846184 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b8e5b03e-7e2b-4d33-8b09-252c21ecbb0a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:00.846631 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b8e5b03e-7e2b-4d33-8b09-252c21ecbb0a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:00.847494 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b8e5b03e-7e2b-4d33-8b09-252c21ecbb0a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:00.847912 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b8e5b03e-7e2b-4d33-8b09-252c21ecbb0a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:00.984765 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b8e5b03e-7e2b-4d33-8b09-252c21ecbb0a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:00.994463 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b8e5b03e-7e2b-4d33-8b09-252c21ecbb0a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1672 microversion: 2.1 time: 0.159180 Feb 10 03:42:00.995162 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 379/748] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:00 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:01.427388 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dabd0ddb-a4eb-4564-aba5-3b446f3dac14 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:01.428087 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dabd0ddb-a4eb-4564-aba5-3b446f3dac14 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:01.435030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dabd0ddb-a4eb-4564-aba5-3b446f3dac14 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:01.435486 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dabd0ddb-a4eb-4564-aba5-3b446f3dac14 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:01.436262 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dabd0ddb-a4eb-4564-aba5-3b446f3dac14 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:01.436700 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dabd0ddb-a4eb-4564-aba5-3b446f3dac14 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:01.611486 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dabd0ddb-a4eb-4564-aba5-3b446f3dac14 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:01.620006 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dabd0ddb-a4eb-4564-aba5-3b446f3dac14 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.196811 Feb 10 03:42:01.620772 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 370/749] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:01 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:42:02.011630 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-019c67a0-3b72-4c52-b22f-b964cf457d31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:02.012381 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-019c67a0-3b72-4c52-b22f-b964cf457d31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:02.018843 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-019c67a0-3b72-4c52-b22f-b964cf457d31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:02.019294 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-019c67a0-3b72-4c52-b22f-b964cf457d31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:02.020137 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-019c67a0-3b72-4c52-b22f-b964cf457d31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:02.020576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-019c67a0-3b72-4c52-b22f-b964cf457d31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:02.186938 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-019c67a0-3b72-4c52-b22f-b964cf457d31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:02.194258 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-019c67a0-3b72-4c52-b22f-b964cf457d31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1672 microversion: 2.1 time: 0.186392 Feb 10 03:42:02.194875 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 380/750] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:02 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:02.636829 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-88437a36-92f0-4447-a5cf-1c36da7e33c7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:02.637476 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-88437a36-92f0-4447-a5cf-1c36da7e33c7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:02.643810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-88437a36-92f0-4447-a5cf-1c36da7e33c7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:02.644270 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-88437a36-92f0-4447-a5cf-1c36da7e33c7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:02.645045 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-88437a36-92f0-4447-a5cf-1c36da7e33c7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:02.645474 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-88437a36-92f0-4447-a5cf-1c36da7e33c7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:02.795793 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-88437a36-92f0-4447-a5cf-1c36da7e33c7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:02.803800 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-88437a36-92f0-4447-a5cf-1c36da7e33c7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1756 microversion: 2.1 time: 0.170669 Feb 10 03:42:02.804566 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 371/751] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:02 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:03.210796 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6f3fa02c-7fb5-472c-b1df-3f5bdfb9df30 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:03.212033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6f3fa02c-7fb5-472c-b1df-3f5bdfb9df30 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:03.218603 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f3fa02c-7fb5-472c-b1df-3f5bdfb9df30 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:03.218956 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f3fa02c-7fb5-472c-b1df-3f5bdfb9df30 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:03.219782 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f3fa02c-7fb5-472c-b1df-3f5bdfb9df30 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:03.220239 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f3fa02c-7fb5-472c-b1df-3f5bdfb9df30 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:03.377312 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6f3fa02c-7fb5-472c-b1df-3f5bdfb9df30 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:03.385614 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6f3fa02c-7fb5-472c-b1df-3f5bdfb9df30 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1672 microversion: 2.1 time: 0.178690 Feb 10 03:42:03.386299 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 381/752] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:03 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:03.821025 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fcca7680-9d0f-40a2-9942-061fc25be01f tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:03.821636 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fcca7680-9d0f-40a2-9942-061fc25be01f tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:03.828315 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fcca7680-9d0f-40a2-9942-061fc25be01f tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:03.828827 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fcca7680-9d0f-40a2-9942-061fc25be01f tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:03.829812 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fcca7680-9d0f-40a2-9942-061fc25be01f tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:03.830453 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fcca7680-9d0f-40a2-9942-061fc25be01f tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:03.982054 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fcca7680-9d0f-40a2-9942-061fc25be01f tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:03.990150 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fcca7680-9d0f-40a2-9942-061fc25be01f tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1759 microversion: 2.1 time: 0.172937 Feb 10 03:42:03.990743 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 372/753] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:03 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:04.014128 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-09cfb3a5-ec2c-4bc3-8c09-2f78468c77ff req-9326e6f9-4bdc-4eb3-82d1-b811ada75fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60b46a9-24cb-430f-83bd-3c74a87a08cd", "name": "network-vif-deleted", "tag": "2f6a5eaa-729c-49cc-aff5-a2c491acd54d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:04.015813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:04.015813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:42:04.023013 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-09cfb3a5-ec2c-4bc3-8c09-2f78468c77ff req-9326e6f9-4bdc-4eb3-82d1-b811ada75fff service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:04.023453 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-09cfb3a5-ec2c-4bc3-8c09-2f78468c77ff req-9326e6f9-4bdc-4eb3-82d1-b811ada75fff service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:04.035502 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-09cfb3a5-ec2c-4bc3-8c09-2f78468c77ff req-9326e6f9-4bdc-4eb3-82d1-b811ada75fff service nova] Creating event network-vif-deleted:2f6a5eaa-729c-49cc-aff5-a2c491acd54d for instance d60b46a9-24cb-430f-83bd-3c74a87a08cd on hv-cinder-82806 Feb 10 03:42:04.046061 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-09cfb3a5-ec2c-4bc3-8c09-2f78468c77ff req-9326e6f9-4bdc-4eb3-82d1-b811ada75fff service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035716 Feb 10 03:42:04.048991 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 382/754] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:04.403051 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:04.403564 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:04.409901 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:04.410347 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:04.411160 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:04.411616 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:04.441460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:04.441909 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:04.442344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lazy-loading 'fault' on Instance uuid d60b46a9-24cb-430f-83bd-3c74a87a08cd {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:42:04.483725 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:04.492307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0d740d77-4353-4dc9-96e5-7e368779761a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 200 len: 1327 microversion: 2.1 time: 0.093027 Feb 10 03:42:04.492892 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 373/755] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:04 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:05.511805 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:05.512384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:05.519246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:05.519692 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:05.520471 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:05.520900 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:05.534160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] HTTP exception thrown: Instance d60b46a9-24cb-430f-83bd-3c74a87a08cd could not be found. Feb 10 03:42:05.534768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Returning 404 to user: Instance d60b46a9-24cb-430f-83bd-3c74a87a08cd could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:42:05.535607 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4e05cddd-a227-40e0-8bb1-e9450bf7db08 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 404 len: 111 microversion: 2.1 time: 0.028739 Feb 10 03:42:05.536133 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 383/756] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:05 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:42:05.544660 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4bcd43d1-0a8a-420b-badf-5fd618140fd1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '.version_select at 0x7fe95a3709d0>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:05.563951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4bcd43d1-0a8a-420b-badf-5fd618140fd1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807446414" status: 202 len: 0 microversion: 2.1 time: 0.022951 Feb 10 03:42:05.564553 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 374/757] 10.222.0.32 () {58 vars in 1217 bytes} [Thu Feb 10 03:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807446414 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:42:06.452480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-09675ca4-ed1f-4972-8adf-584b5cf7ddb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'create', calling method: .version_select at 0x7fe95ad24280>, body: {"keypair": {"name": "tempest-keypair-1116660292"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:06.472222 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-09675ca4-ed1f-4972-8adf-584b5cf7ddb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'key_pairs'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:42:06.476312 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-09675ca4-ed1f-4972-8adf-584b5cf7ddb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for user fc1ef6f6170f4ccb9e3b439ac3fd56e0 and project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'key_pairs'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:42:06.639532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-df3e4d5b-7497-4293-8799-9394177bc11b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:06.640068 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-df3e4d5b-7497-4293-8799-9394177bc11b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:06.647307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-df3e4d5b-7497-4293-8799-9394177bc11b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:06.648003 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-df3e4d5b-7497-4293-8799-9394177bc11b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:06.648794 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-df3e4d5b-7497-4293-8799-9394177bc11b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:06.649221 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-df3e4d5b-7497-4293-8799-9394177bc11b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:06.673685 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-df3e4d5b-7497-4293-8799-9394177bc11b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Going to try to terminate instance {{(pid=127951) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:42:06.754423 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-df3e4d5b-7497-4293-8799-9394177bc11b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 204 len: 0 microversion: 2.1 time: 0.119119 Feb 10 03:42:06.755441 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 375/758] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:42:06 2022] DELETE /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:42:06.764304 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a7d565d5-4598-4fc2-8591-738cafde5c60 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:06.765030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a7d565d5-4598-4fc2-8591-738cafde5c60 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:06.770973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a7d565d5-4598-4fc2-8591-738cafde5c60 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:06.771483 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a7d565d5-4598-4fc2-8591-738cafde5c60 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:06.772479 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a7d565d5-4598-4fc2-8591-738cafde5c60 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:06.773170 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a7d565d5-4598-4fc2-8591-738cafde5c60 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:06.906867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-09675ca4-ed1f-4972-8adf-584b5cf7ddb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'key_pairs'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:42:06.910685 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-09675ca4-ed1f-4972-8adf-584b5cf7ddb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for user fc1ef6f6170f4ccb9e3b439ac3fd56e0 and project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'key_pairs'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:42:06.917164 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a7d565d5-4598-4fc2-8591-738cafde5c60 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:06.924039 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-09675ca4-ed1f-4972-8adf-584b5cf7ddb5 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.475320 Feb 10 03:42:06.924664 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a7d565d5-4598-4fc2-8591-738cafde5c60 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1578 microversion: 2.1 time: 0.164475 Feb 10 03:42:06.929752 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 384/759] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Feb 10 03:42:06 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:06.929886 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 376/760] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:06 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:07.942380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-20f1a8b7-88b0-4365-bf75-2b21d4a5c554 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:07.942978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-20f1a8b7-88b0-4365-bf75-2b21d4a5c554 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:07.949962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20f1a8b7-88b0-4365-bf75-2b21d4a5c554 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:07.950526 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20f1a8b7-88b0-4365-bf75-2b21d4a5c554 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:07.951438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20f1a8b7-88b0-4365-bf75-2b21d4a5c554 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:07.951867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-20f1a8b7-88b0-4365-bf75-2b21d4a5c554 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:08.086593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-20f1a8b7-88b0-4365-bf75-2b21d4a5c554 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:08.094581 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-20f1a8b7-88b0-4365-bf75-2b21d4a5c554 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1578 microversion: 2.1 time: 0.156420 Feb 10 03:42:08.104230 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 385/761] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:07 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:08.249166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1174883824", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d05c7b61-b2b5-4d63-9ad8-889925a1fb38"}], "security_groups": [{"name": "tempest-securitygroup--333697689"}], "key_name": "tempest-keypair-1116660292", "user_data": "}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:08.558786 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] validate_networks() for [('d05c7b61-b2b5-4d63-9ad8-889925a1fb38', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:42:08.924182 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:42:08.924602 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:42:08.925071 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:42:08.925471 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:42:08.925914 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:42:08.935956 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:08.936412 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:08.937221 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:08.937684 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:08.955131 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:42:08.959779 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Getting quotas for user fc1ef6f6170f4ccb9e3b439ac3fd56e0 and project f327fcae4b024948a911ad1bdeb06ad9. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:42:08.972035 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:42:08.974327 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:42:09.019355 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-76247fcc-dd4d-4bba-9099-96ea7423d711 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.774278 Feb 10 03:42:09.020369 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 377/762] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:42:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 10 03:42:09.030225 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-760c396c-f417-4b8a-bad6-5746529c5dbc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:09.030855 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-760c396c-f417-4b8a-bad6-5746529c5dbc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:09.110557 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c591c5ff-a531-4619-9209-88c917568913 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:09.111223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c591c5ff-a531-4619-9209-88c917568913 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:09.117394 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c591c5ff-a531-4619-9209-88c917568913 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:09.117973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c591c5ff-a531-4619-9209-88c917568913 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:09.118617 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c591c5ff-a531-4619-9209-88c917568913 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:09.119704 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c591c5ff-a531-4619-9209-88c917568913 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:09.209902 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-760c396c-f417-4b8a-bad6-5746529c5dbc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:09.219165 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-760c396c-f417-4b8a-bad6-5746529c5dbc tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1238 microversion: 2.1 time: 0.192391 Feb 10 03:42:09.219903 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 386/763] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:09 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1238 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:09.298381 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c591c5ff-a531-4619-9209-88c917568913 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:09.306052 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c591c5ff-a531-4619-9209-88c917568913 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1578 microversion: 2.1 time: 0.199144 Feb 10 03:42:09.306628 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 378/764] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:09 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:42:10.239264 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-fea72d5b-265f-492f-9920-83149d75c6fb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:10.240306 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-fea72d5b-265f-492f-9920-83149d75c6fb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:10.248469 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fea72d5b-265f-492f-9920-83149d75c6fb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:10.248952 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fea72d5b-265f-492f-9920-83149d75c6fb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:10.249725 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fea72d5b-265f-492f-9920-83149d75c6fb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:10.250158 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fea72d5b-265f-492f-9920-83149d75c6fb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:10.317486 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-fea72d5b-265f-492f-9920-83149d75c6fb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:10.322990 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-87fd3ffc-9ac0-4403-9f32-c4b6217ffb63 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:10.323549 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-87fd3ffc-9ac0-4403-9f32-c4b6217ffb63 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:10.325389 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-fea72d5b-265f-492f-9920-83149d75c6fb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1242 microversion: 2.1 time: 0.092232 Feb 10 03:42:10.325977 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 387/765] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:10 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:10.330265 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87fd3ffc-9ac0-4403-9f32-c4b6217ffb63 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:10.330750 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87fd3ffc-9ac0-4403-9f32-c4b6217ffb63 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:10.331649 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87fd3ffc-9ac0-4403-9f32-c4b6217ffb63 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:10.332086 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-87fd3ffc-9ac0-4403-9f32-c4b6217ffb63 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:10.476361 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-87fd3ffc-9ac0-4403-9f32-c4b6217ffb63 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:10.487455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-87fd3ffc-9ac0-4403-9f32-c4b6217ffb63 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1578 microversion: 2.1 time: 0.167914 Feb 10 03:42:10.488239 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 379/766] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:10 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:11.345500 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0f98349e-5f71-4bcd-bd2c-d2e76cfaeb53 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:11.346449 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0f98349e-5f71-4bcd-bd2c-d2e76cfaeb53 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:11.355063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f98349e-5f71-4bcd-bd2c-d2e76cfaeb53 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:11.355512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f98349e-5f71-4bcd-bd2c-d2e76cfaeb53 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:11.356295 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f98349e-5f71-4bcd-bd2c-d2e76cfaeb53 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:11.356724 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0f98349e-5f71-4bcd-bd2c-d2e76cfaeb53 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:11.418079 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0f98349e-5f71-4bcd-bd2c-d2e76cfaeb53 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:11.425453 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0f98349e-5f71-4bcd-bd2c-d2e76cfaeb53 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1242 microversion: 2.1 time: 0.086382 Feb 10 03:42:11.426060 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 388/767] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:11 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:11.505383 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bf65e9c1-00ca-4fbd-9519-451a4c6e6dcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:11.505986 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bf65e9c1-00ca-4fbd-9519-451a4c6e6dcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:11.513469 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf65e9c1-00ca-4fbd-9519-451a4c6e6dcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:11.513920 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf65e9c1-00ca-4fbd-9519-451a4c6e6dcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:11.514741 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf65e9c1-00ca-4fbd-9519-451a4c6e6dcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:11.515181 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bf65e9c1-00ca-4fbd-9519-451a4c6e6dcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:11.667025 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bf65e9c1-00ca-4fbd-9519-451a4c6e6dcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:11.674625 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bf65e9c1-00ca-4fbd-9519-451a4c6e6dcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1578 microversion: 2.1 time: 0.172936 Feb 10 03:42:11.675251 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 380/768] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:11 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:12.442785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b48fc40c-f6c0-4495-ac78-fe48bd8b5b65 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:12.443475 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b48fc40c-f6c0-4495-ac78-fe48bd8b5b65 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:12.450154 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b48fc40c-f6c0-4495-ac78-fe48bd8b5b65 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:12.450580 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b48fc40c-f6c0-4495-ac78-fe48bd8b5b65 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:12.451381 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b48fc40c-f6c0-4495-ac78-fe48bd8b5b65 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:12.451813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b48fc40c-f6c0-4495-ac78-fe48bd8b5b65 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:12.518291 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b48fc40c-f6c0-4495-ac78-fe48bd8b5b65 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:12.526807 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b48fc40c-f6c0-4495-ac78-fe48bd8b5b65 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1296 microversion: 2.1 time: 0.087649 Feb 10 03:42:12.527401 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 389/769] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:12 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:12.692564 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e167c062-1bd0-4465-811e-a0f597849704 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:12.693854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e167c062-1bd0-4465-811e-a0f597849704 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:12.701541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e167c062-1bd0-4465-811e-a0f597849704 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:12.702310 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e167c062-1bd0-4465-811e-a0f597849704 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:12.703388 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e167c062-1bd0-4465-811e-a0f597849704 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:12.704025 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e167c062-1bd0-4465-811e-a0f597849704 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:12.853965 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e167c062-1bd0-4465-811e-a0f597849704 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:12.864437 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e167c062-1bd0-4465-811e-a0f597849704 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1578 microversion: 2.1 time: 0.173737 Feb 10 03:42:12.864437 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 381/770] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:12 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:13.545961 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-bab9b012-71ff-4b30-a653-7614222359e1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:13.547110 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-bab9b012-71ff-4b30-a653-7614222359e1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:13.554151 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bab9b012-71ff-4b30-a653-7614222359e1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:13.554598 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bab9b012-71ff-4b30-a653-7614222359e1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:13.555592 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bab9b012-71ff-4b30-a653-7614222359e1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:13.556028 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bab9b012-71ff-4b30-a653-7614222359e1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:13.698253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-bab9b012-71ff-4b30-a653-7614222359e1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:13.706731 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-bab9b012-71ff-4b30-a653-7614222359e1 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.165846 Feb 10 03:42:13.707515 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 390/771] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:13 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:13.880499 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d4c2ed1f-eb72-46c1-a680-b426d26f3bd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:13.881447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d4c2ed1f-eb72-46c1-a680-b426d26f3bd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:13.888938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4c2ed1f-eb72-46c1-a680-b426d26f3bd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:13.889388 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4c2ed1f-eb72-46c1-a680-b426d26f3bd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:13.890177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4c2ed1f-eb72-46c1-a680-b426d26f3bd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:13.890614 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4c2ed1f-eb72-46c1-a680-b426d26f3bd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:13.964919 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d4c2ed1f-eb72-46c1-a680-b426d26f3bd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:13.974153 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d4c2ed1f-eb72-46c1-a680-b426d26f3bd0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1511 microversion: 2.1 time: 0.098614 Feb 10 03:42:13.975604 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 382/772] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:13 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:14.081230 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-a8108d37-d07f-4645-a571-d92451a359c0 req-2798e2cb-369a-4151-ac8b-7707f1313a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6526425c-4ed8-4fc2-982e-cfa3c75087c3", "name": "network-vif-deleted", "tag": "336de512-11fe-4594-b1b4-1b948f7eceab"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:14.082861 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:14.082861 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:42:14.103616 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-a8108d37-d07f-4645-a571-d92451a359c0 req-2798e2cb-369a-4151-ac8b-7707f1313a80 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:14.104069 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-a8108d37-d07f-4645-a571-d92451a359c0 req-2798e2cb-369a-4151-ac8b-7707f1313a80 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:14.116811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-a8108d37-d07f-4645-a571-d92451a359c0 req-2798e2cb-369a-4151-ac8b-7707f1313a80 service nova] Creating event network-vif-deleted:336de512-11fe-4594-b1b4-1b948f7eceab for instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 on hv-cinder-82806 Feb 10 03:42:14.123825 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-a8108d37-d07f-4645-a571-d92451a359c0 req-2798e2cb-369a-4151-ac8b-7707f1313a80 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047247 Feb 10 03:42:14.124826 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 391/773] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:14.723612 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f5183efb-c217-426d-85a7-b3c9bd59840a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:14.724217 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f5183efb-c217-426d-85a7-b3c9bd59840a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:14.730187 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5183efb-c217-426d-85a7-b3c9bd59840a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:14.730639 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5183efb-c217-426d-85a7-b3c9bd59840a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:14.731478 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5183efb-c217-426d-85a7-b3c9bd59840a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:14.731909 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5183efb-c217-426d-85a7-b3c9bd59840a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:14.863940 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f5183efb-c217-426d-85a7-b3c9bd59840a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:14.871664 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f5183efb-c217-426d-85a7-b3c9bd59840a tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.151776 Feb 10 03:42:14.872523 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 383/774] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:14 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:14.992717 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8948e6d1-ef22-4a15-9a90-f0dabd83f241 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:14.993438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8948e6d1-ef22-4a15-9a90-f0dabd83f241 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:15.000585 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8948e6d1-ef22-4a15-9a90-f0dabd83f241 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:15.001025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8948e6d1-ef22-4a15-9a90-f0dabd83f241 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:15.001796 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8948e6d1-ef22-4a15-9a90-f0dabd83f241 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:15.002242 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8948e6d1-ef22-4a15-9a90-f0dabd83f241 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:15.073649 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8948e6d1-ef22-4a15-9a90-f0dabd83f241 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:15.081623 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8948e6d1-ef22-4a15-9a90-f0dabd83f241 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1226 microversion: 2.1 time: 0.093584 Feb 10 03:42:15.082188 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 392/775] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:14 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:15.892252 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-63a8967f-507a-40e2-bac4-250527d10f38 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:15.893285 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-63a8967f-507a-40e2-bac4-250527d10f38 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:15.904010 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-63a8967f-507a-40e2-bac4-250527d10f38 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:15.904759 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-63a8967f-507a-40e2-bac4-250527d10f38 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:15.906043 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-63a8967f-507a-40e2-bac4-250527d10f38 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:15.906813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-63a8967f-507a-40e2-bac4-250527d10f38 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:16.050923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-63a8967f-507a-40e2-bac4-250527d10f38 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:16.059241 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-63a8967f-507a-40e2-bac4-250527d10f38 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.173121 Feb 10 03:42:16.059896 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 384/776] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:15 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:16.098605 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5adf7044-2126-4e9b-bdea-42f5d01ea486 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:16.099319 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5adf7044-2126-4e9b-bdea-42f5d01ea486 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:16.106191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5adf7044-2126-4e9b-bdea-42f5d01ea486 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:16.106672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5adf7044-2126-4e9b-bdea-42f5d01ea486 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:16.107454 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5adf7044-2126-4e9b-bdea-42f5d01ea486 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:16.107876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5adf7044-2126-4e9b-bdea-42f5d01ea486 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:16.139657 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-c8dc99fd-2fde-41eb-b3a1-d1b422a51a88 req-b147b3d2-23a5-4a41-8d19-2561b0fb000e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a602fde-ab06-459f-83dc-10ee456f77e5", "tag": "55725b88-e980-424f-91f6-78757fc06a2a"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:16.141318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:16.141318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:42:16.148376 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-c8dc99fd-2fde-41eb-b3a1-d1b422a51a88 req-b147b3d2-23a5-4a41-8d19-2561b0fb000e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:16.149184 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-c8dc99fd-2fde-41eb-b3a1-d1b422a51a88 req-b147b3d2-23a5-4a41-8d19-2561b0fb000e service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:16.163682 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-c8dc99fd-2fde-41eb-b3a1-d1b422a51a88 req-b147b3d2-23a5-4a41-8d19-2561b0fb000e service nova] Creating event network-changed:55725b88-e980-424f-91f6-78757fc06a2a for instance 2a602fde-ab06-459f-83dc-10ee456f77e5 on hv-cinder-82806 Feb 10 03:42:16.168676 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-c8dc99fd-2fde-41eb-b3a1-d1b422a51a88 req-b147b3d2-23a5-4a41-8d19-2561b0fb000e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032929 Feb 10 03:42:16.169242 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 385/777] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:16.169600 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5adf7044-2126-4e9b-bdea-42f5d01ea486 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:16.177191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5adf7044-2126-4e9b-bdea-42f5d01ea486 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1226 microversion: 2.1 time: 0.082485 Feb 10 03:42:16.177732 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 393/778] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:16 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:17.075858 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-125de460-0103-4392-81a8-322db8895e4f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:17.076637 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-125de460-0103-4392-81a8-322db8895e4f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:17.083704 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-125de460-0103-4392-81a8-322db8895e4f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:17.084163 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-125de460-0103-4392-81a8-322db8895e4f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:17.085062 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-125de460-0103-4392-81a8-322db8895e4f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:17.085478 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-125de460-0103-4392-81a8-322db8895e4f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:17.193177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-72487767-68d5-4e22-86c6-8caa86113e1f tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:17.193913 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-72487767-68d5-4e22-86c6-8caa86113e1f tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:17.204912 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-72487767-68d5-4e22-86c6-8caa86113e1f tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:17.206516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-72487767-68d5-4e22-86c6-8caa86113e1f tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:17.207727 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-72487767-68d5-4e22-86c6-8caa86113e1f tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:17.208521 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-72487767-68d5-4e22-86c6-8caa86113e1f tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:17.230266 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-125de460-0103-4392-81a8-322db8895e4f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:17.238071 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-125de460-0103-4392-81a8-322db8895e4f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.166292 Feb 10 03:42:17.238973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 386/779] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:17 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:17.269463 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-72487767-68d5-4e22-86c6-8caa86113e1f tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:17.278189 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-72487767-68d5-4e22-86c6-8caa86113e1f tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 200 len: 1226 microversion: 2.1 time: 0.088328 Feb 10 03:42:17.279062 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 394/780] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:17 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:18.255200 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0ce92eb3-1ea2-4985-9af6-58b04829da31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:18.255977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0ce92eb3-1ea2-4985-9af6-58b04829da31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:18.263861 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0ce92eb3-1ea2-4985-9af6-58b04829da31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:18.264311 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0ce92eb3-1ea2-4985-9af6-58b04829da31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:18.265089 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0ce92eb3-1ea2-4985-9af6-58b04829da31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:18.265541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0ce92eb3-1ea2-4985-9af6-58b04829da31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:18.296496 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:18.297316 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:18.304325 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:18.304876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:18.305749 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:18.306261 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:18.320379 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] HTTP exception thrown: Instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 could not be found. Feb 10 03:42:18.321335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Returning 404 to user: Instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:42:18.322375 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-24c91be4-2798-49c7-8ef3-ce92a74a5e98 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 404 len: 111 microversion: 2.1 time: 0.029593 Feb 10 03:42:18.323183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 395/781] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:18 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:42:18.409777 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0ce92eb3-1ea2-4985-9af6-58b04829da31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:18.420771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-612020292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1051863551", "security_groups": [{"name": "tempest-secgroup-smoke-497865012"}], "block_device_mapping_v2": [{"uuid": "264870f4-c316-442d-925a-5bfd33641903", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3af7982f-b432-4a57-9896-b601a1ffbd3e"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:18.421364 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0ce92eb3-1ea2-4985-9af6-58b04829da31 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.169882 Feb 10 03:42:18.421969 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 387/782] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:18 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:18.531199 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] validate_networks() for [('3af7982f-b432-4a57-9896-b601a1ffbd3e', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:42:18.952663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:42:18.953193 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:42:18.953902 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:42:18.954540 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:42:18.955233 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:42:18.970959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:18.971551 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:18.972884 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:18.973549 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:18.991262 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for project 9861d9e039084b9b9b24721464eea6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:42:18.995696 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for user 1521bf93314c437798ef374963def38e and project 9861d9e039084b9b9b24721464eea6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:42:19.058446 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:42:19.060688 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='264870f4-c316-442d-925a-5bfd33641903',volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:42:19.192360 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-9d725b05-473c-4f38-b83d-e588bc180add tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.775144 Feb 10 03:42:19.192960 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 396/783] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:42:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 10 03:42:19.203435 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-64faf48c-edde-4e86-859a-fee1dc4bba3e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:19.204136 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-64faf48c-edde-4e86-859a-fee1dc4bba3e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:19.261419 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-64faf48c-edde-4e86-859a-fee1dc4bba3e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:19.268796 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-64faf48c-edde-4e86-859a-fee1dc4bba3e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1094 microversion: 2.1 time: 0.069173 Feb 10 03:42:19.269370 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 388/784] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:19 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:19.438435 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-23a5cbeb-b739-4a5e-ac27-4f2e0bfccdfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:19.439116 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-23a5cbeb-b739-4a5e-ac27-4f2e0bfccdfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:19.445030 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-23a5cbeb-b739-4a5e-ac27-4f2e0bfccdfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:19.445474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-23a5cbeb-b739-4a5e-ac27-4f2e0bfccdfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:19.446307 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-23a5cbeb-b739-4a5e-ac27-4f2e0bfccdfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:19.446810 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-23a5cbeb-b739-4a5e-ac27-4f2e0bfccdfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:19.627732 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-23a5cbeb-b739-4a5e-ac27-4f2e0bfccdfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:19.635988 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-23a5cbeb-b739-4a5e-ac27-4f2e0bfccdfe tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.201348 Feb 10 03:42:19.636890 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 397/785] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:19 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:20.285784 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-677db609-cb45-43d8-8565-a202429e7fc3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:20.286387 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-677db609-cb45-43d8-8565-a202429e7fc3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:20.293785 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-677db609-cb45-43d8-8565-a202429e7fc3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:20.294246 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-677db609-cb45-43d8-8565-a202429e7fc3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:20.295074 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-677db609-cb45-43d8-8565-a202429e7fc3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:20.295523 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-677db609-cb45-43d8-8565-a202429e7fc3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:20.363513 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-677db609-cb45-43d8-8565-a202429e7fc3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:20.372062 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-677db609-cb45-43d8-8565-a202429e7fc3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1136 microversion: 2.1 time: 0.089817 Feb 10 03:42:20.373040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 389/786] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:20 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1136 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:20.656701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ac81f3d0-8605-4176-a135-faf1f283624b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:20.657607 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ac81f3d0-8605-4176-a135-faf1f283624b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:20.668126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ac81f3d0-8605-4176-a135-faf1f283624b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:20.668824 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ac81f3d0-8605-4176-a135-faf1f283624b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:20.670115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ac81f3d0-8605-4176-a135-faf1f283624b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:20.670878 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ac81f3d0-8605-4176-a135-faf1f283624b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:20.812475 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ac81f3d0-8605-4176-a135-faf1f283624b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:20.823623 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ac81f3d0-8605-4176-a135-faf1f283624b tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.172881 Feb 10 03:42:20.824287 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 398/787] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:20 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:21.392032 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b85bbce7-19d7-4857-ab43-62f297d9b54a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:21.392633 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b85bbce7-19d7-4857-ab43-62f297d9b54a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:21.399721 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b85bbce7-19d7-4857-ab43-62f297d9b54a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:21.400176 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b85bbce7-19d7-4857-ab43-62f297d9b54a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:21.400966 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b85bbce7-19d7-4857-ab43-62f297d9b54a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:21.401401 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b85bbce7-19d7-4857-ab43-62f297d9b54a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:21.475604 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b85bbce7-19d7-4857-ab43-62f297d9b54a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:21.483066 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b85bbce7-19d7-4857-ab43-62f297d9b54a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1192 microversion: 2.1 time: 0.094778 Feb 10 03:42:21.483633 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 390/788] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:21 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:21.848396 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f1fbae47-5340-4232-9e90-20745ef28ab0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:21.849384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f1fbae47-5340-4232-9e90-20745ef28ab0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:21.856996 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f1fbae47-5340-4232-9e90-20745ef28ab0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:21.857471 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f1fbae47-5340-4232-9e90-20745ef28ab0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:21.858295 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f1fbae47-5340-4232-9e90-20745ef28ab0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:21.858796 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f1fbae47-5340-4232-9e90-20745ef28ab0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:22.003498 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f1fbae47-5340-4232-9e90-20745ef28ab0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:22.010949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f1fbae47-5340-4232-9e90-20745ef28ab0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.168692 Feb 10 03:42:22.011519 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 399/789] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:21 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:22.502050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-18500c81-28be-40b1-891a-9cf24d9e4333 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:22.502897 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-18500c81-28be-40b1-891a-9cf24d9e4333 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:22.510974 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18500c81-28be-40b1-891a-9cf24d9e4333 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:22.511425 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18500c81-28be-40b1-891a-9cf24d9e4333 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:22.512206 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18500c81-28be-40b1-891a-9cf24d9e4333 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:22.512640 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18500c81-28be-40b1-891a-9cf24d9e4333 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:22.581704 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-18500c81-28be-40b1-891a-9cf24d9e4333 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:22.589544 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-18500c81-28be-40b1-891a-9cf24d9e4333 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1192 microversion: 2.1 time: 0.092840 Feb 10 03:42:22.590108 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 391/790] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:22 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:23.028119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dc0d923f-6172-42d9-9fa0-85fac9059ecb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:23.028917 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dc0d923f-6172-42d9-9fa0-85fac9059ecb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:23.037665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc0d923f-6172-42d9-9fa0-85fac9059ecb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:23.038211 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc0d923f-6172-42d9-9fa0-85fac9059ecb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:23.039040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc0d923f-6172-42d9-9fa0-85fac9059ecb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:23.039480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc0d923f-6172-42d9-9fa0-85fac9059ecb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:23.201680 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dc0d923f-6172-42d9-9fa0-85fac9059ecb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:23.209430 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dc0d923f-6172-42d9-9fa0-85fac9059ecb tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.185448 Feb 10 03:42:23.210408 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 400/791] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:23 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:23.606506 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c7c660e1-6d94-4ecf-a9ac-99624980fc79 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:23.607088 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c7c660e1-6d94-4ecf-a9ac-99624980fc79 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:23.613484 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c7c660e1-6d94-4ecf-a9ac-99624980fc79 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:23.613935 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c7c660e1-6d94-4ecf-a9ac-99624980fc79 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:23.614779 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c7c660e1-6d94-4ecf-a9ac-99624980fc79 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:23.615224 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c7c660e1-6d94-4ecf-a9ac-99624980fc79 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:23.676465 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c7c660e1-6d94-4ecf-a9ac-99624980fc79 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:23.689039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c7c660e1-6d94-4ecf-a9ac-99624980fc79 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1210 microversion: 2.1 time: 0.086677 Feb 10 03:42:23.689544 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 392/792] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:23 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:24.227259 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8d2cf613-fff1-4cc9-aefd-5d2794acd22d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:24.227798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8d2cf613-fff1-4cc9-aefd-5d2794acd22d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:24.234681 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8d2cf613-fff1-4cc9-aefd-5d2794acd22d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:24.235237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8d2cf613-fff1-4cc9-aefd-5d2794acd22d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:24.236103 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8d2cf613-fff1-4cc9-aefd-5d2794acd22d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:24.236610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8d2cf613-fff1-4cc9-aefd-5d2794acd22d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:24.380215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8d2cf613-fff1-4cc9-aefd-5d2794acd22d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:24.388670 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8d2cf613-fff1-4cc9-aefd-5d2794acd22d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.165216 Feb 10 03:42:24.389360 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 401/793] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:24 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:24.705558 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-97488ca7-ad14-49ed-a579-8393632e28ca tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:24.706212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-97488ca7-ad14-49ed-a579-8393632e28ca tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:24.714083 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97488ca7-ad14-49ed-a579-8393632e28ca tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:24.714856 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97488ca7-ad14-49ed-a579-8393632e28ca tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:24.715831 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97488ca7-ad14-49ed-a579-8393632e28ca tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:24.716425 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-97488ca7-ad14-49ed-a579-8393632e28ca tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:24.845156 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-e73d1753-79f8-402b-9623-043ea0aa6b7d req-c0cdd623-c578-4b4f-953e-6b0e9e0e1f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a602fde-ab06-459f-83dc-10ee456f77e5", "name": "network-vif-plugged", "status": "completed", "tag": "55725b88-e980-424f-91f6-78757fc06a2a"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:24.847477 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:24.847477 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:42:24.856236 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-e73d1753-79f8-402b-9623-043ea0aa6b7d req-c0cdd623-c578-4b4f-953e-6b0e9e0e1f23 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:24.858116 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-e73d1753-79f8-402b-9623-043ea0aa6b7d req-c0cdd623-c578-4b4f-953e-6b0e9e0e1f23 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:24.881785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-e73d1753-79f8-402b-9623-043ea0aa6b7d req-c0cdd623-c578-4b4f-953e-6b0e9e0e1f23 service nova] Creating event network-vif-plugged:55725b88-e980-424f-91f6-78757fc06a2a for instance 2a602fde-ab06-459f-83dc-10ee456f77e5 on hv-cinder-82806 Feb 10 03:42:24.898041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-e73d1753-79f8-402b-9623-043ea0aa6b7d req-c0cdd623-c578-4b4f-953e-6b0e9e0e1f23 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063752 Feb 10 03:42:24.898702 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 402/794] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:24.909723 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-21dcb05a-83ef-4067-8036-078ca803575f req-d75e7fda-6074-45e6-8ce1-8f728705bc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9639e1b6-e005-4646-80c2-7d526aedf8f2", "tag": "ed384a80-1f9f-476a-b97b-aa412b2f3e8e"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:24.910987 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:24.910987 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:42:24.925116 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-97488ca7-ad14-49ed-a579-8393632e28ca tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:24.932893 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-97488ca7-ad14-49ed-a579-8393632e28ca tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.231027 Feb 10 03:42:24.943613 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 393/795] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:24 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:24.944420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-21dcb05a-83ef-4067-8036-078ca803575f req-d75e7fda-6074-45e6-8ce1-8f728705bc0b service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:24.944420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-21dcb05a-83ef-4067-8036-078ca803575f req-d75e7fda-6074-45e6-8ce1-8f728705bc0b service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:24.953807 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-21dcb05a-83ef-4067-8036-078ca803575f req-d75e7fda-6074-45e6-8ce1-8f728705bc0b service nova] Creating event network-changed:ed384a80-1f9f-476a-b97b-aa412b2f3e8e for instance 9639e1b6-e005-4646-80c2-7d526aedf8f2 on hv-cinder-82806 Feb 10 03:42:24.958797 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-21dcb05a-83ef-4067-8036-078ca803575f req-d75e7fda-6074-45e6-8ce1-8f728705bc0b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057155 Feb 10 03:42:24.959645 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 403/796] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:25.481691 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9f74661b-6263-4e50-a16d-d75e4f615e67 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:25.482306 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9f74661b-6263-4e50-a16d-d75e4f615e67 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:25.488860 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9f74661b-6263-4e50-a16d-d75e4f615e67 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:25.489315 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9f74661b-6263-4e50-a16d-d75e4f615e67 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:25.490064 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9f74661b-6263-4e50-a16d-d75e4f615e67 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:25.490526 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9f74661b-6263-4e50-a16d-d75e4f615e67 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:25.628350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-9f74661b-6263-4e50-a16d-d75e4f615e67 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:25.637594 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9f74661b-6263-4e50-a16d-d75e4f615e67 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.233909 Feb 10 03:42:25.638259 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 394/797] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:25 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:25.955392 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-099647f3-b675-4919-988c-cdf5723b5e3a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:25.956436 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-099647f3-b675-4919-988c-cdf5723b5e3a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:25.964749 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-099647f3-b675-4919-988c-cdf5723b5e3a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:25.965199 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-099647f3-b675-4919-988c-cdf5723b5e3a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:25.965980 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-099647f3-b675-4919-988c-cdf5723b5e3a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:25.966427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-099647f3-b675-4919-988c-cdf5723b5e3a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:26.111769 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-099647f3-b675-4919-988c-cdf5723b5e3a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:26.120198 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-099647f3-b675-4919-988c-cdf5723b5e3a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.172433 Feb 10 03:42:26.120777 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 404/798] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:25 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:26.658960 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b01dfe0b-6ab5-410c-80d5-c18f6ba78272 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:26.659975 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b01dfe0b-6ab5-410c-80d5-c18f6ba78272 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:26.670875 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b01dfe0b-6ab5-410c-80d5-c18f6ba78272 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:26.671630 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b01dfe0b-6ab5-410c-80d5-c18f6ba78272 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:26.672924 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b01dfe0b-6ab5-410c-80d5-c18f6ba78272 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:26.673649 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b01dfe0b-6ab5-410c-80d5-c18f6ba78272 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:26.816291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b01dfe0b-6ab5-410c-80d5-c18f6ba78272 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:26.824077 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b01dfe0b-6ab5-410c-80d5-c18f6ba78272 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.171367 Feb 10 03:42:26.824632 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 395/799] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:26 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:27.144139 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c64d8e4a-32ef-4fa1-ba86-813327192bf3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:27.145079 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c64d8e4a-32ef-4fa1-ba86-813327192bf3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:27.155833 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c64d8e4a-32ef-4fa1-ba86-813327192bf3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:27.156593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c64d8e4a-32ef-4fa1-ba86-813327192bf3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:27.157925 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c64d8e4a-32ef-4fa1-ba86-813327192bf3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:27.158694 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c64d8e4a-32ef-4fa1-ba86-813327192bf3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:27.300740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c64d8e4a-32ef-4fa1-ba86-813327192bf3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:27.309520 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c64d8e4a-32ef-4fa1-ba86-813327192bf3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.171623 Feb 10 03:42:27.310070 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 405/800] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:27 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:27.844656 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ab423dba-5764-4ef7-8491-e5f5263d4610 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:27.845647 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ab423dba-5764-4ef7-8491-e5f5263d4610 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:27.854988 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ab423dba-5764-4ef7-8491-e5f5263d4610 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:27.855443 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ab423dba-5764-4ef7-8491-e5f5263d4610 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:27.856223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ab423dba-5764-4ef7-8491-e5f5263d4610 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:27.856662 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ab423dba-5764-4ef7-8491-e5f5263d4610 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:27.993342 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ab423dba-5764-4ef7-8491-e5f5263d4610 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:28.001788 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ab423dba-5764-4ef7-8491-e5f5263d4610 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.163692 Feb 10 03:42:28.002362 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 396/801] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:27 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:28.329805 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dc7cc3f3-cc14-4911-bda1-1d3448c151dc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:28.330849 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-dc7cc3f3-cc14-4911-bda1-1d3448c151dc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:28.339211 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc7cc3f3-cc14-4911-bda1-1d3448c151dc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:28.339652 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc7cc3f3-cc14-4911-bda1-1d3448c151dc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:28.340424 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc7cc3f3-cc14-4911-bda1-1d3448c151dc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:28.340858 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-dc7cc3f3-cc14-4911-bda1-1d3448c151dc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:28.474184 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-dc7cc3f3-cc14-4911-bda1-1d3448c151dc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:28.482246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dc7cc3f3-cc14-4911-bda1-1d3448c151dc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.158604 Feb 10 03:42:28.483041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 406/802] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:28 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:28.819718 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-18189dc0-7be1-4ffd-85eb-22e13cafd335 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:28.820340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-18189dc0-7be1-4ffd-85eb-22e13cafd335 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:28.826532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18189dc0-7be1-4ffd-85eb-22e13cafd335 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:28.827037 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18189dc0-7be1-4ffd-85eb-22e13cafd335 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:28.827817 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18189dc0-7be1-4ffd-85eb-22e13cafd335 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:28.828272 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18189dc0-7be1-4ffd-85eb-22e13cafd335 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:28.851589 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-18189dc0-7be1-4ffd-85eb-22e13cafd335 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lazy-loading 'flavor' on Instance uuid 68175f5a-583d-43b3-a6f6-3b045303c1d1 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:42:29.020814 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5128a3b7-91d0-442f-b9d3-394807fba197 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:29.021824 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5128a3b7-91d0-442f-b9d3-394807fba197 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:29.028200 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5128a3b7-91d0-442f-b9d3-394807fba197 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:29.028653 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5128a3b7-91d0-442f-b9d3-394807fba197 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:29.029500 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5128a3b7-91d0-442f-b9d3-394807fba197 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:29.029934 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5128a3b7-91d0-442f-b9d3-394807fba197 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:29.105097 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-18189dc0-7be1-4ffd-85eb-22e13cafd335 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/action" status: 202 len: 0 microversion: 2.20 time: 0.388175 Feb 10 03:42:29.105648 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 397/803] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Feb 10 03:42:28 2022] POST /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:42:29.113995 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:29.114752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:29.122348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:29.122834 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:29.123625 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:29.124063 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:29.185974 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5128a3b7-91d0-442f-b9d3-394807fba197 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:29.194039 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5128a3b7-91d0-442f-b9d3-394807fba197 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1363 microversion: 2.1 time: 0.176897 Feb 10 03:42:29.198775 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 407/804] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:29 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:29.278221 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:29.286190 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:29.287711 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:29.288857 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f7f57974-30ac-4f61-a055-2124a78c03eb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.178958 Feb 10 03:42:29.289425 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 398/805] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:29 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:42:29.499782 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3b6f9970-7860-40e5-9478-591c2da9e7e6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:29.500498 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3b6f9970-7860-40e5-9478-591c2da9e7e6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:29.506946 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3b6f9970-7860-40e5-9478-591c2da9e7e6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:29.507400 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3b6f9970-7860-40e5-9478-591c2da9e7e6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:29.512462 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3b6f9970-7860-40e5-9478-591c2da9e7e6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:29.512916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3b6f9970-7860-40e5-9478-591c2da9e7e6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:29.667473 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3b6f9970-7860-40e5-9478-591c2da9e7e6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:29.682512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3b6f9970-7860-40e5-9478-591c2da9e7e6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.186712 Feb 10 03:42:29.683130 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 408/806] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:29 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:30.214729 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a4c8329a-6c75-4db1-91f1-cf0671d1e890 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:30.215803 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a4c8329a-6c75-4db1-91f1-cf0671d1e890 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:30.226493 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4c8329a-6c75-4db1-91f1-cf0671d1e890 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:30.227353 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4c8329a-6c75-4db1-91f1-cf0671d1e890 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:30.228131 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4c8329a-6c75-4db1-91f1-cf0671d1e890 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:30.228567 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4c8329a-6c75-4db1-91f1-cf0671d1e890 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:30.309053 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:30.309670 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:30.316002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:30.316466 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:30.317246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:30.317686 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:30.389731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a4c8329a-6c75-4db1-91f1-cf0671d1e890 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:30.397152 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a4c8329a-6c75-4db1-91f1-cf0671d1e890 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1548 microversion: 2.1 time: 0.188641 Feb 10 03:42:30.397723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 399/807] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:30 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:30.413280 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9cb80334-c8dc-4dbd-a0b1-f401bb0c434f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:30.413821 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9cb80334-c8dc-4dbd-a0b1-f401bb0c434f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:30.419956 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9cb80334-c8dc-4dbd-a0b1-f401bb0c434f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:30.420455 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9cb80334-c8dc-4dbd-a0b1-f401bb0c434f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:30.421236 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9cb80334-c8dc-4dbd-a0b1-f401bb0c434f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:30.421665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9cb80334-c8dc-4dbd-a0b1-f401bb0c434f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:30.468711 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:30.476784 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:30.478302 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:30.479473 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c0c466de-a108-41b9-8a17-8ba39fb6e9ba tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.174329 Feb 10 03:42:30.480037 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 409/808] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:30 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:30.510226 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9cb80334-c8dc-4dbd-a0b1-f401bb0c434f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100267 Feb 10 03:42:30.511061 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 400/809] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Feb 10 03:42:30 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:30.701864 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-86237945-8d3b-4eab-9d18-8cd8bab711f7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:30.702682 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-86237945-8d3b-4eab-9d18-8cd8bab711f7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:30.710051 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-86237945-8d3b-4eab-9d18-8cd8bab711f7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:30.710516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-86237945-8d3b-4eab-9d18-8cd8bab711f7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:30.711477 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-86237945-8d3b-4eab-9d18-8cd8bab711f7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:30.711920 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-86237945-8d3b-4eab-9d18-8cd8bab711f7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:30.864374 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-86237945-8d3b-4eab-9d18-8cd8bab711f7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:30.872582 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-86237945-8d3b-4eab-9d18-8cd8bab711f7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.175560 Feb 10 03:42:30.873149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 410/810] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:30 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:31.498247 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:31.498931 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:31.506930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:31.507378 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:31.508143 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:31.508857 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:31.523043 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-81a73161-63f8-44e6-b7fa-ab8051e65f3e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:31.523662 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-81a73161-63f8-44e6-b7fa-ab8051e65f3e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:31.529617 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-81a73161-63f8-44e6-b7fa-ab8051e65f3e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:31.530069 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-81a73161-63f8-44e6-b7fa-ab8051e65f3e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:31.530971 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-81a73161-63f8-44e6-b7fa-ab8051e65f3e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:31.531409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-81a73161-63f8-44e6-b7fa-ab8051e65f3e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:31.713218 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:31.720601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-81a73161-63f8-44e6-b7fa-ab8051e65f3e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:31.721683 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:31.723318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:31.724570 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-db6cf5cd-deb1-49fa-ab29-4e16963d46d8 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.230977 Feb 10 03:42:31.725218 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 401/811] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:31 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:31.729771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-81a73161-63f8-44e6-b7fa-ab8051e65f3e tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1548 microversion: 2.1 time: 0.210270 Feb 10 03:42:31.738989 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 411/812] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:31 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:31.787928 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-25d40fe9-bd52-47b7-a046-e700cd78d992 req-2c6def33-e5bb-4dc0-bbad-4fdcad967ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a602fde-ab06-459f-83dc-10ee456f77e5", "tag": "55725b88-e980-424f-91f6-78757fc06a2a"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:31.789603 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:31.789603 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:42:31.796428 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-25d40fe9-bd52-47b7-a046-e700cd78d992 req-2c6def33-e5bb-4dc0-bbad-4fdcad967ee7 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:31.796876 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-25d40fe9-bd52-47b7-a046-e700cd78d992 req-2c6def33-e5bb-4dc0-bbad-4fdcad967ee7 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:31.807766 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-25d40fe9-bd52-47b7-a046-e700cd78d992 req-2c6def33-e5bb-4dc0-bbad-4fdcad967ee7 service nova] Creating event network-changed:55725b88-e980-424f-91f6-78757fc06a2a for instance 2a602fde-ab06-459f-83dc-10ee456f77e5 on hv-cinder-82806 Feb 10 03:42:31.813184 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-25d40fe9-bd52-47b7-a046-e700cd78d992 req-2c6def33-e5bb-4dc0-bbad-4fdcad967ee7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086589 Feb 10 03:42:31.813779 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 402/813] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:31.889720 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f4a008d0-0470-4349-9118-fe0c40b767d3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:31.890459 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f4a008d0-0470-4349-9118-fe0c40b767d3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:31.896883 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f4a008d0-0470-4349-9118-fe0c40b767d3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:31.897655 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f4a008d0-0470-4349-9118-fe0c40b767d3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:31.898684 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f4a008d0-0470-4349-9118-fe0c40b767d3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:31.899379 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f4a008d0-0470-4349-9118-fe0c40b767d3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:32.060240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f4a008d0-0470-4349-9118-fe0c40b767d3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:32.068488 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f4a008d0-0470-4349-9118-fe0c40b767d3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.182707 Feb 10 03:42:32.080441 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 412/814] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:31 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:32.746467 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-959df761-4bd9-4ac9-8a87-f4bd93e037b9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:32.751164 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:32.751637 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-959df761-4bd9-4ac9-8a87-f4bd93e037b9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:32.752735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:32.759779 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-959df761-4bd9-4ac9-8a87-f4bd93e037b9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:32.760619 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-959df761-4bd9-4ac9-8a87-f4bd93e037b9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:32.761587 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-959df761-4bd9-4ac9-8a87-f4bd93e037b9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:32.761786 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:32.762037 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-959df761-4bd9-4ac9-8a87-f4bd93e037b9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:32.762415 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:32.763406 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:32.763838 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:32.968165 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-959df761-4bd9-4ac9-8a87-f4bd93e037b9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:32.976434 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:32.977384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-959df761-4bd9-4ac9-8a87-f4bd93e037b9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1667 microversion: 2.1 time: 0.234738 Feb 10 03:42:32.977968 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 413/815] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:32 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1667 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:32.985841 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:32.988036 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:32.989277 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a042062a-0c35-46c1-9273-3b1e0dc56095 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.249782 Feb 10 03:42:32.990378 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 403/816] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:32 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:42:32.994930 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ea5110a6-d06b-4d1b-9604-0e8e13cf2fd0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:32.995516 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ea5110a6-d06b-4d1b-9604-0e8e13cf2fd0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:33.002071 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea5110a6-d06b-4d1b-9604-0e8e13cf2fd0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:33.002527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea5110a6-d06b-4d1b-9604-0e8e13cf2fd0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:33.003346 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea5110a6-d06b-4d1b-9604-0e8e13cf2fd0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:33.003790 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ea5110a6-d06b-4d1b-9604-0e8e13cf2fd0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:33.028424 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ea5110a6-d06b-4d1b-9604-0e8e13cf2fd0 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/ips" status: 200 len: 145 microversion: 2.1 time: 0.037644 Feb 10 03:42:33.028958 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 414/817] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Feb 10 03:42:32 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:33.087898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fcfa37f7-81cf-463e-8c42-9ffe4fad09f0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:33.088499 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fcfa37f7-81cf-463e-8c42-9ffe4fad09f0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:33.094759 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fcfa37f7-81cf-463e-8c42-9ffe4fad09f0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:33.095320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fcfa37f7-81cf-463e-8c42-9ffe4fad09f0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:33.096298 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fcfa37f7-81cf-463e-8c42-9ffe4fad09f0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:33.097045 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fcfa37f7-81cf-463e-8c42-9ffe4fad09f0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:33.244310 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fcfa37f7-81cf-463e-8c42-9ffe4fad09f0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:33.253902 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fcfa37f7-81cf-463e-8c42-9ffe4fad09f0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.169631 Feb 10 03:42:33.254562 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 404/818] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:33 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:34.008549 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:34.009150 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:34.016051 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:34.016604 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:34.017622 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:34.018051 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:34.155489 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:34.163382 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:34.164946 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:34.166103 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-92d38f5c-068a-43f5-a327-03bbdd69c657 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.161387 Feb 10 03:42:34.166682 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 415/819] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:34 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:34.271318 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-eb8d86af-e478-4093-9eb3-c0524e01d63b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:34.271909 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-eb8d86af-e478-4093-9eb3-c0524e01d63b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:34.278748 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb8d86af-e478-4093-9eb3-c0524e01d63b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:34.279169 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb8d86af-e478-4093-9eb3-c0524e01d63b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:34.279957 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb8d86af-e478-4093-9eb3-c0524e01d63b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:34.280379 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-eb8d86af-e478-4093-9eb3-c0524e01d63b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:34.388232 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1723f27e-a9c6-4d7a-aac9-d18150ce796f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "725c5ad3-a318-40d4-b0a0-31328bb51223"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:34.389324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1723f27e-a9c6-4d7a-aac9-d18150ce796f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:34.396298 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1723f27e-a9c6-4d7a-aac9-d18150ce796f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:34.396740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1723f27e-a9c6-4d7a-aac9-d18150ce796f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:34.397526 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1723f27e-a9c6-4d7a-aac9-d18150ce796f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:34.397959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1723f27e-a9c6-4d7a-aac9-d18150ce796f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:34.433643 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-eb8d86af-e478-4093-9eb3-c0524e01d63b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:34.441200 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-eb8d86af-e478-4093-9eb3-c0524e01d63b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.173745 Feb 10 03:42:34.442004 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 405/820] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:34 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:34.662882 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1723f27e-a9c6-4d7a-aac9-d18150ce796f tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278393 Feb 10 03:42:34.663484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 416/821] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:42:34 2022] POST /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:42:35.183943 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:35.184680 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:35.190868 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:35.191398 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:35.192246 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:35.192751 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:35.330805 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:35.339027 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:35.340610 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:35.341805 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dc702df3-0de0-4b70-8105-4ae4624f19c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.161993 Feb 10 03:42:35.342360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 406/822] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:35 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:35.459060 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c080e178-3735-486f-a2c6-5eedc6e1d75b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:35.459967 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c080e178-3735-486f-a2c6-5eedc6e1d75b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:35.469683 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c080e178-3735-486f-a2c6-5eedc6e1d75b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:35.470086 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c080e178-3735-486f-a2c6-5eedc6e1d75b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:35.470916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c080e178-3735-486f-a2c6-5eedc6e1d75b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:35.471326 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c080e178-3735-486f-a2c6-5eedc6e1d75b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:35.613489 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c080e178-3735-486f-a2c6-5eedc6e1d75b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:35.622095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c080e178-3735-486f-a2c6-5eedc6e1d75b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.167964 Feb 10 03:42:35.622868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 417/823] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:35 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:36.360991 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:36.361661 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:36.369302 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:36.369758 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:36.370552 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:36.371016 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:36.523835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:36.532145 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:36.533654 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:36.534850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-374f4e12-2dfd-4291-a740-c17a10988583 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.178077 Feb 10 03:42:36.535416 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 407/824] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:36 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:36.639223 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e0b86dcf-2deb-4b14-92c4-5a92721f3a7d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:36.639867 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e0b86dcf-2deb-4b14-92c4-5a92721f3a7d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:36.646668 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e0b86dcf-2deb-4b14-92c4-5a92721f3a7d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:36.647156 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e0b86dcf-2deb-4b14-92c4-5a92721f3a7d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:36.647981 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e0b86dcf-2deb-4b14-92c4-5a92721f3a7d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:36.648437 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e0b86dcf-2deb-4b14-92c4-5a92721f3a7d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:36.801024 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e0b86dcf-2deb-4b14-92c4-5a92721f3a7d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:36.808800 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e0b86dcf-2deb-4b14-92c4-5a92721f3a7d tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.173454 Feb 10 03:42:36.809814 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 418/825] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:36 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:37.553447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:37.554065 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:37.560559 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:37.561102 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:37.561934 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:37.562365 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:37.698219 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:37.707255 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:37.708758 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:37.709913 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-baca58ee-6cff-4a08-ba7d-29cbc0d989c1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.160363 Feb 10 03:42:37.710546 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 408/826] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:37 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:37.826182 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6063bf5e-4296-412d-bfb4-0e0ac893e6cd tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:37.826768 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6063bf5e-4296-412d-bfb4-0e0ac893e6cd tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:37.833188 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6063bf5e-4296-412d-bfb4-0e0ac893e6cd tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:37.833637 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6063bf5e-4296-412d-bfb4-0e0ac893e6cd tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:37.834414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6063bf5e-4296-412d-bfb4-0e0ac893e6cd tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:37.834887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6063bf5e-4296-412d-bfb4-0e0ac893e6cd tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:37.988991 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6063bf5e-4296-412d-bfb4-0e0ac893e6cd tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:37.997190 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6063bf5e-4296-412d-bfb4-0e0ac893e6cd tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.174917 Feb 10 03:42:37.997760 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 419/827] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:37 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:38.734371 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:38.735623 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:38.742212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:38.742707 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:38.743823 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:38.744356 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:38.827281 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-323851e2-ae83-46b9-b642-6aad59c35336 req-64de0798-a160-49bc-8f34-9c1faef8c78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9639e1b6-e005-4646-80c2-7d526aedf8f2", "name": "network-vif-plugged", "status": "completed", "tag": "ed384a80-1f9f-476a-b97b-aa412b2f3e8e"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:38.828857 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:38.828857 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:42:38.837853 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-323851e2-ae83-46b9-b642-6aad59c35336 req-64de0798-a160-49bc-8f34-9c1faef8c78a service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:38.838340 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-323851e2-ae83-46b9-b642-6aad59c35336 req-64de0798-a160-49bc-8f34-9c1faef8c78a service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:38.853578 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-323851e2-ae83-46b9-b642-6aad59c35336 req-64de0798-a160-49bc-8f34-9c1faef8c78a service nova] Creating event network-vif-plugged:ed384a80-1f9f-476a-b97b-aa412b2f3e8e for instance 9639e1b6-e005-4646-80c2-7d526aedf8f2 on hv-cinder-82806 Feb 10 03:42:38.860247 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-323851e2-ae83-46b9-b642-6aad59c35336 req-64de0798-a160-49bc-8f34-9c1faef8c78a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037288 Feb 10 03:42:38.861770 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 420/828] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:42:38.947092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:38.953998 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:38.955522 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:38.956692 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-181880df-55da-4950-9009-d21c25279d37 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.226234 Feb 10 03:42:38.957232 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 409/829] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:38 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:39.017089 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-217e9ac3-a59c-42a3-afdd-b568656feafe tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:39.017796 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-217e9ac3-a59c-42a3-afdd-b568656feafe tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:39.025589 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-217e9ac3-a59c-42a3-afdd-b568656feafe tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:39.026336 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-217e9ac3-a59c-42a3-afdd-b568656feafe tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:39.027209 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-217e9ac3-a59c-42a3-afdd-b568656feafe tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:39.027695 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-217e9ac3-a59c-42a3-afdd-b568656feafe tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:39.225643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-217e9ac3-a59c-42a3-afdd-b568656feafe tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:39.245372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-217e9ac3-a59c-42a3-afdd-b568656feafe tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.231619 Feb 10 03:42:39.253220 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 421/830] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:39 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:39.976473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:39.977038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:39.983552 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:39.984142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:39.984943 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:39.985532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:40.123503 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:40.134132 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:40.134132 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:40.134681 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-89ff122f-f624-4388-a82f-f930d2490eb7 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1742 microversion: 2.20 time: 0.162448 Feb 10 03:42:40.135293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 410/831] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:39 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:40.261411 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-95aa4173-8bdd-45dd-8219-76bbef53bc84 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:40.261864 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-95aa4173-8bdd-45dd-8219-76bbef53bc84 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:40.268785 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-95aa4173-8bdd-45dd-8219-76bbef53bc84 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:40.269349 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-95aa4173-8bdd-45dd-8219-76bbef53bc84 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:40.270213 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-95aa4173-8bdd-45dd-8219-76bbef53bc84 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:40.270637 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-95aa4173-8bdd-45dd-8219-76bbef53bc84 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:40.410187 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-95aa4173-8bdd-45dd-8219-76bbef53bc84 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:40.418395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-95aa4173-8bdd-45dd-8219-76bbef53bc84 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1265 microversion: 2.1 time: 0.160900 Feb 10 03:42:40.438914 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 422/832] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:40 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:41.152645 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:41.153369 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:41.160312 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:41.160850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:41.161705 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:41.162216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:41.305205 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:41.314846 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:41.317482 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:41.319320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e475cf43-16eb-4255-9d63-aeb8524b92b5 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1742 microversion: 2.20 time: 0.170356 Feb 10 03:42:41.320129 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 411/833] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:41 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:41.436058 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-657c6846-91b9-459e-a111-2ec697d6db49 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:41.436663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-657c6846-91b9-459e-a111-2ec697d6db49 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:41.443496 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-657c6846-91b9-459e-a111-2ec697d6db49 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:41.443947 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-657c6846-91b9-459e-a111-2ec697d6db49 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:41.444739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-657c6846-91b9-459e-a111-2ec697d6db49 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:41.445143 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-657c6846-91b9-459e-a111-2ec697d6db49 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:41.584434 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-657c6846-91b9-459e-a111-2ec697d6db49 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:41.593710 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-657c6846-91b9-459e-a111-2ec697d6db49 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1451 microversion: 2.1 time: 0.161202 Feb 10 03:42:41.594409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 423/834] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:41 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:41.610696 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fb006e62-d16f-41d6-bb48-382e3cb85442 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:41.611335 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fb006e62-d16f-41d6-bb48-382e3cb85442 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:41.618226 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fb006e62-d16f-41d6-bb48-382e3cb85442 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:41.619291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fb006e62-d16f-41d6-bb48-382e3cb85442 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:41.620427 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fb006e62-d16f-41d6-bb48-382e3cb85442 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:41.621066 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fb006e62-d16f-41d6-bb48-382e3cb85442 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:41.777592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fb006e62-d16f-41d6-bb48-382e3cb85442 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:41.786494 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fb006e62-d16f-41d6-bb48-382e3cb85442 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1451 microversion: 2.1 time: 0.179469 Feb 10 03:42:41.787302 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 412/835] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:41 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:42:42.163763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c364618a-377b-4bf4-8384-f57583e4d9c9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:42.164682 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c364618a-377b-4bf4-8384-f57583e4d9c9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:42.170700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c364618a-377b-4bf4-8384-f57583e4d9c9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:42.171176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c364618a-377b-4bf4-8384-f57583e4d9c9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:42.171973 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c364618a-377b-4bf4-8384-f57583e4d9c9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:42.172384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c364618a-377b-4bf4-8384-f57583e4d9c9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:42.201794 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c364618a-377b-4bf4-8384-f57583e4d9c9 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041649 Feb 10 03:42:42.202603 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 424/836] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:42:42 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:42.212868 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a1bea13e-4c08-4630-867f-270e5368bb96 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:42.213457 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a1bea13e-4c08-4630-867f-270e5368bb96 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:42.220507 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a1bea13e-4c08-4630-867f-270e5368bb96 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:42.220946 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a1bea13e-4c08-4630-867f-270e5368bb96 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:42.221837 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a1bea13e-4c08-4630-867f-270e5368bb96 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:42.222281 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a1bea13e-4c08-4630-867f-270e5368bb96 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:42.261618 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a1bea13e-4c08-4630-867f-270e5368bb96 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/725c5ad3-a318-40d4-b0a0-31328bb51223" status: 200 len: 194 microversion: 2.1 time: 0.052650 Feb 10 03:42:42.262959 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 413/837] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Feb 10 03:42:42 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/725c5ad3-a318-40d4-b0a0-31328bb51223 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:42.341907 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:42.343186 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:42.353549 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:42.354931 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:42.355897 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:42.356513 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:42.504706 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:42.532667 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:42.534697 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:42.536120 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7fa644ce-3545-426c-979e-a6ca2c66e471 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1742 microversion: 2.20 time: 0.201209 Feb 10 03:42:42.536748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 425/838] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:42 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1742 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:43.554603 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:43.556033 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:43.564805 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:43.565541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:43.566528 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:43.566996 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:43.630536 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d9d391d3-d738-4a62-a83d-564516a5d4df tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f294dc82-2bde-4a25-8890-73bfc8c274d5"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:43.632342 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d9d391d3-d738-4a62-a83d-564516a5d4df tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:43.639301 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d9d391d3-d738-4a62-a83d-564516a5d4df tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:43.640028 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d9d391d3-d738-4a62-a83d-564516a5d4df tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:43.640993 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d9d391d3-d738-4a62-a83d-564516a5d4df tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:43.641593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d9d391d3-d738-4a62-a83d-564516a5d4df tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:43.799075 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:43.812501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:43.814284 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:43.815691 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-cc322ea9-7f50-435e-83fe-1df3cebf8a99 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1737 microversion: 2.20 time: 0.264917 Feb 10 03:42:43.816749 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 414/839] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:43 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1737 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:44.041875 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-f80a05a5-b9b2-4050-9e0e-fa224cb61fb2 req-7d196712-a67c-454b-a9d4-6b8cd4dbb2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9639e1b6-e005-4646-80c2-7d526aedf8f2", "tag": "ed384a80-1f9f-476a-b97b-aa412b2f3e8e"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:44.045240 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:44.045240 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:42:44.056002 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-f80a05a5-b9b2-4050-9e0e-fa224cb61fb2 req-7d196712-a67c-454b-a9d4-6b8cd4dbb2f8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:44.056770 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-f80a05a5-b9b2-4050-9e0e-fa224cb61fb2 req-7d196712-a67c-454b-a9d4-6b8cd4dbb2f8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:44.092281 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d9d391d3-d738-4a62-a83d-564516a5d4df tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "POST /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465407 Feb 10 03:42:44.095530 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 426/840] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:42:43 2022] POST /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:42:44.097699 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-f80a05a5-b9b2-4050-9e0e-fa224cb61fb2 req-7d196712-a67c-454b-a9d4-6b8cd4dbb2f8 service nova] Creating event network-changed:ed384a80-1f9f-476a-b97b-aa412b2f3e8e for instance 9639e1b6-e005-4646-80c2-7d526aedf8f2 on hv-cinder-82806 Feb 10 03:42:44.103967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-f80a05a5-b9b2-4050-9e0e-fa224cb61fb2 req-7d196712-a67c-454b-a9d4-6b8cd4dbb2f8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070457 Feb 10 03:42:44.105288 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 415/841] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:44.840361 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:44.841772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:44.850533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:44.851265 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:44.852894 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:44.854177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:45.020001 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:45.030841 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:45.032991 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:45.034792 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-cdbbaeb9-10c2-459f-8c43-0c21e6ba797e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1737 microversion: 2.20 time: 0.200298 Feb 10 03:42:45.046446 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 427/842] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:44 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:45.363875 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-0e7c49ab-8162-4df6-aeab-dce7f56cd5fd req-09046792-d9c7-437b-a31c-6f96fa2b737d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68175f5a-583d-43b3-a6f6-3b045303c1d1", "name": "network-vif-plugged", "status": "completed", "tag": "dd4ed260-10d2-4b11-ae4a-2e37c7f81db6"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:45.366055 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:45.366055 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:42:45.374220 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-0e7c49ab-8162-4df6-aeab-dce7f56cd5fd req-09046792-d9c7-437b-a31c-6f96fa2b737d service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:45.374934 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-0e7c49ab-8162-4df6-aeab-dce7f56cd5fd req-09046792-d9c7-437b-a31c-6f96fa2b737d service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:45.393470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-0e7c49ab-8162-4df6-aeab-dce7f56cd5fd req-09046792-d9c7-437b-a31c-6f96fa2b737d service nova] Creating event network-vif-plugged:dd4ed260-10d2-4b11-ae4a-2e37c7f81db6 for instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 on hv-cinder-82806 Feb 10 03:42:45.398360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-0e7c49ab-8162-4df6-aeab-dce7f56cd5fd req-09046792-d9c7-437b-a31c-6f96fa2b737d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240045 Feb 10 03:42:45.399595 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 416/843] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:46.101160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:46.101835 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:46.136980 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:46.137739 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:46.138544 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:46.139003 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:46.319949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:46.339374 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:46.340931 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:46.342095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8618d0a9-02ef-40ec-ac72-100b66652c6e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1737 microversion: 2.20 time: 0.272423 Feb 10 03:42:46.344581 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 428/844] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:46 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1737 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:47.362559 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:47.364164 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:47.378296 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:47.379389 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:47.381817 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:47.382489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:47.550413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:47.559857 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:47.561682 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:47.562964 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-da8187f4-5f62-4cf1-b29c-1845637a1354 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1737 microversion: 2.20 time: 0.205240 Feb 10 03:42:47.563711 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 417/845] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:47 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:48.582153 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:48.583444 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:48.590095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:48.590960 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:48.591966 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:48.592403 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:48.764130 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:48.773102 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:48.774713 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:48.776242 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e71f14c9-0f16-41ef-a6e5-20f0657b6806 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1737 microversion: 2.20 time: 0.198224 Feb 10 03:42:48.776727 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 429/846] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:48 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:49.795922 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:49.798393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:49.805777 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:49.806809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:49.807581 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:49.808465 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:49.984447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:49.992927 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:49.994904 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:49.996389 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0394a6cf-6d56-434b-ad88-c1da36a50ed3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1737 microversion: 2.20 time: 0.205823 Feb 10 03:42:50.007250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 418/847] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:49 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:51.014978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:51.015665 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:51.022587 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:51.023110 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:51.023904 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:51.027989 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:51.195539 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:51.204266 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:51.205754 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:51.207240 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6e816cac-0dc2-47f0-9c38-4b8c419f1d7f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1737 microversion: 2.20 time: 0.196401 Feb 10 03:42:51.207818 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 430/848] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:51 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:52.225424 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:52.226014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:52.232726 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:52.233382 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:52.234410 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:52.234975 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:52.378014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:52.385995 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:52.387753 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:52.388923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-57e9b97f-63c0-4218-b7f7-2adf94090cf2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1737 microversion: 2.20 time: 0.167295 Feb 10 03:42:52.389480 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 419/849] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:52 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:52.841526 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-36ec45c1-a3e8-40b8-baa0-a77f0c7beb98 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:52.842461 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-36ec45c1-a3e8-40b8-baa0-a77f0c7beb98 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:52.848771 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-36ec45c1-a3e8-40b8-baa0-a77f0c7beb98 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:52.849216 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-36ec45c1-a3e8-40b8-baa0-a77f0c7beb98 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:52.849987 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-36ec45c1-a3e8-40b8-baa0-a77f0c7beb98 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:52.850460 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-36ec45c1-a3e8-40b8-baa0-a77f0c7beb98 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:52.880544 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-36ec45c1-a3e8-40b8-baa0-a77f0c7beb98 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043772 Feb 10 03:42:52.880998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 431/850] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:42:52 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:53.069150 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d6d9be24-29cc-42c6-86bd-aa7c5cd944b7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1178662493"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:53.069689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d6d9be24-29cc-42c6-86bd-aa7c5cd944b7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:53.080042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d6d9be24-29cc-42c6-86bd-aa7c5cd944b7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:53.080500 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d6d9be24-29cc-42c6-86bd-aa7c5cd944b7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:53.081275 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d6d9be24-29cc-42c6-86bd-aa7c5cd944b7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:53.081708 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d6d9be24-29cc-42c6-86bd-aa7c5cd944b7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:53.225971 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.network.security_group_api [None req-d6d9be24-29cc-42c6-86bd-aa7c5cd944b7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Removing security group d2dabf78-172c-46ea-90a9-a593f4fddf86 from port 21a54a32-023a-446a-a188-568375c7704d Feb 10 03:42:53.406862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:53.407455 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:53.413438 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:53.413823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:53.414593 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:53.415048 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:53.642754 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d6d9be24-29cc-42c6-86bd-aa7c5cd944b7 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "POST /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/action" status: 202 len: 0 microversion: 2.1 time: 0.576839 Feb 10 03:42:53.643084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 420/851] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:42:53 2022] POST /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:42:53.695976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:53.704871 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:53.706498 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:53.708534 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a739a3d5-b84d-41be-9898-98f7c30fdea3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1719 microversion: 2.20 time: 0.305423 Feb 10 03:42:53.728411 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 432/852] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:53 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1719 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:42:53.750863 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-1ab05f27-6edb-42f4-908d-4b91eef74127 req-4e46d959-d32f-4512-ad0e-5045471849e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a528a15b-6851-416c-9040-245fa3c93b88", "tag": "21a54a32-023a-446a-a188-568375c7704d"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:53.752914 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:53.752914 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:42:53.765469 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-1ab05f27-6edb-42f4-908d-4b91eef74127 req-4e46d959-d32f-4512-ad0e-5045471849e7 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:53.767736 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-1ab05f27-6edb-42f4-908d-4b91eef74127 req-4e46d959-d32f-4512-ad0e-5045471849e7 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:53.782549 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-1ab05f27-6edb-42f4-908d-4b91eef74127 req-4e46d959-d32f-4512-ad0e-5045471849e7 service nova] Creating event network-changed:21a54a32-023a-446a-a188-568375c7704d for instance a528a15b-6851-416c-9040-245fa3c93b88 on hv-cinder-82806 Feb 10 03:42:53.790273 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-1ab05f27-6edb-42f4-908d-4b91eef74127 req-4e46d959-d32f-4512-ad0e-5045471849e7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141208 Feb 10 03:42:53.791264 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 421/853] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:54.727573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:54.728693 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:54.734609 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:54.735107 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:54.735890 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:54.736335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:54.886358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:54.895480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:54.897010 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:54.898474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-696b817b-3a20-47f4-bb4f-bbdd792563a2 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1719 microversion: 2.20 time: 0.174696 Feb 10 03:42:54.899465 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 433/854] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:54 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:55.592178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-12e14c4b-973d-4772-b9fc-789e6f37d8e5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:55.592767 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-12e14c4b-973d-4772-b9fc-789e6f37d8e5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:55.593724 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-62150bd9-6b0a-4156-b8c7-fd9151daef95 req-7d5b8595-74b4-4bff-80e7-d91b0fa51989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a528a15b-6851-416c-9040-245fa3c93b88", "tag": "21a54a32-023a-446a-a188-568375c7704d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:55.595420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:55.595420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:42:55.600335 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12e14c4b-973d-4772-b9fc-789e6f37d8e5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:55.600794 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12e14c4b-973d-4772-b9fc-789e6f37d8e5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:55.601584 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12e14c4b-973d-4772-b9fc-789e6f37d8e5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:55.602023 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-12e14c4b-973d-4772-b9fc-789e6f37d8e5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:55.603111 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-62150bd9-6b0a-4156-b8c7-fd9151daef95 req-7d5b8595-74b4-4bff-80e7-d91b0fa51989 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:55.603611 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-62150bd9-6b0a-4156-b8c7-fd9151daef95 req-7d5b8595-74b4-4bff-80e7-d91b0fa51989 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:55.614409 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-62150bd9-6b0a-4156-b8c7-fd9151daef95 req-7d5b8595-74b4-4bff-80e7-d91b0fa51989 service nova] Creating event network-changed:21a54a32-023a-446a-a188-568375c7704d for instance a528a15b-6851-416c-9040-245fa3c93b88 on hv-cinder-82806 Feb 10 03:42:55.619725 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-62150bd9-6b0a-4156-b8c7-fd9151daef95 req-7d5b8595-74b4-4bff-80e7-d91b0fa51989 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029889 Feb 10 03:42:55.620396 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 434/855] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:55.689391 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-12e14c4b-973d-4772-b9fc-789e6f37d8e5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lazy-loading 'services' on Instance uuid a528a15b-6851-416c-9040-245fa3c93b88 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:42:55.763561 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-12e14c4b-973d-4772-b9fc-789e6f37d8e5 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments/e3e2e2cd-c56f-4a5c-8787-b451ffc383da" status: 202 len: 0 microversion: 2.1 time: 0.175725 Feb 10 03:42:55.765201 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 422/856] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:42:55 2022] DELETE /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments/e3e2e2cd-c56f-4a5c-8787-b451ffc383da => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:42:55.773849 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1faac2f9-2f76-4369-8cfe-4a2fb300c16b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:55.775671 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1faac2f9-2f76-4369-8cfe-4a2fb300c16b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:55.783094 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1faac2f9-2f76-4369-8cfe-4a2fb300c16b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:55.783760 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1faac2f9-2f76-4369-8cfe-4a2fb300c16b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:55.784877 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1faac2f9-2f76-4369-8cfe-4a2fb300c16b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:55.785472 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1faac2f9-2f76-4369-8cfe-4a2fb300c16b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:55.817668 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1faac2f9-2f76-4369-8cfe-4a2fb300c16b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048670 Feb 10 03:42:55.821973 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 435/857] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:42:55 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:55.918011 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:55.918838 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:55.925564 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:55.926235 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:55.932396 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:55.933706 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:56.076809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:56.084590 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:56.086109 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:56.087242 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4b6fcba2-03a5-4501-82b5-8e44bacc2acc tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1719 microversion: 2.20 time: 0.174523 Feb 10 03:42:56.094702 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 423/858] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:55 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:56.812107 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-a2d75819-5850-4c48-9c41-cea31db1630a req-e05260cd-b094-48a4-a303-c44da1176de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68175f5a-583d-43b3-a6f6-3b045303c1d1", "name": "network-vif-unplugged", "status": "completed", "tag": "dd4ed260-10d2-4b11-ae4a-2e37c7f81db6"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:56.813606 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:42:56.813606 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:42:56.820950 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-a2d75819-5850-4c48-9c41-cea31db1630a req-e05260cd-b094-48a4-a303-c44da1176de0 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:56.821628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-a2d75819-5850-4c48-9c41-cea31db1630a req-e05260cd-b094-48a4-a303-c44da1176de0 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:56.833272 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-9d33e7fe-ccae-4784-82d5-f550d540be5b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:56.833772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-a2d75819-5850-4c48-9c41-cea31db1630a req-e05260cd-b094-48a4-a303-c44da1176de0 service nova] Creating event network-vif-unplugged:dd4ed260-10d2-4b11-ae4a-2e37c7f81db6 for instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 on hv-cinder-82806 Feb 10 03:42:56.835363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-9d33e7fe-ccae-4784-82d5-f550d540be5b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:56.838837 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-a2d75819-5850-4c48-9c41-cea31db1630a req-e05260cd-b094-48a4-a303-c44da1176de0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030239 Feb 10 03:42:56.839811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 436/859] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:42:56.849344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9d33e7fe-ccae-4784-82d5-f550d540be5b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:56.849801 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9d33e7fe-ccae-4784-82d5-f550d540be5b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:56.850615 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9d33e7fe-ccae-4784-82d5-f550d540be5b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:56.851072 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-9d33e7fe-ccae-4784-82d5-f550d540be5b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:56.880811 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-9d33e7fe-ccae-4784-82d5-f550d540be5b tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055069 Feb 10 03:42:56.881375 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 424/860] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:42:56 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 10 03:42:56.891714 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:56.892370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:56.898701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:56.899153 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:56.899940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:56.900370 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:56.978207 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] HTTP exception thrown: Instance a528a15b-6851-416c-9040-245fa3c93b88 is not attached to volume e3e2e2cd-c56f-4a5c-8787-b451ffc383da Feb 10 03:42:56.978847 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Returning 404 to user: Instance a528a15b-6851-416c-9040-245fa3c93b88 is not attached to volume e3e2e2cd-c56f-4a5c-8787-b451ffc383da {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:42:56.979793 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-84e77241-699a-46a4-a1ec-8afa4e173f42 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments/e3e2e2cd-c56f-4a5c-8787-b451ffc383da" status: 404 len: 154 microversion: 2.1 time: 0.092239 Feb 10 03:42:56.980343 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 437/861] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:42:56 2022] DELETE /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88/os-volume_attachments/e3e2e2cd-c56f-4a5c-8787-b451ffc383da => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:42:57.106101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:57.106864 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:57.113252 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:57.113677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:57.114412 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:57.114909 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:57.251344 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:57.259975 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:57.261478 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:57.262624 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bd3f6503-77bb-44d8-90c0-b10e51833e04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1722 microversion: 2.20 time: 0.160959 Feb 10 03:42:57.263253 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 425/862] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:57 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:57.280962 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-af540906-7271-449d-86d6-c3d84bca6324 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00fb88c8-b004-4720-b51b-10c2beef8c80"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:57.282172 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-af540906-7271-449d-86d6-c3d84bca6324 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:57.288405 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af540906-7271-449d-86d6-c3d84bca6324 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:57.288857 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af540906-7271-449d-86d6-c3d84bca6324 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:57.289656 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af540906-7271-449d-86d6-c3d84bca6324 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:57.290094 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-af540906-7271-449d-86d6-c3d84bca6324 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:57.573266 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-af540906-7271-449d-86d6-c3d84bca6324 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296344 Feb 10 03:42:57.574253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 438/863] 10.222.0.32 () {62 vars in 1363 bytes} [Thu Feb 10 03:42:57 2022] POST /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 10 03:42:57.686101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-58c24888-0fe7-4149-b8f7-c3c29a17716c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:57.686600 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-58c24888-0fe7-4149-b8f7-c3c29a17716c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:57.699920 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-58c24888-0fe7-4149-b8f7-c3c29a17716c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:57.700397 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-58c24888-0fe7-4149-b8f7-c3c29a17716c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:57.701180 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-58c24888-0fe7-4149-b8f7-c3c29a17716c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:57.701625 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-58c24888-0fe7-4149-b8f7-c3c29a17716c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:57.964276 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-58c24888-0fe7-4149-b8f7-c3c29a17716c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "DELETE /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/os-volume_attachments/00fb88c8-b004-4720-b51b-10c2beef8c80" status: 202 len: 0 microversion: 2.20 time: 0.281922 Feb 10 03:42:57.965014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 426/864] 10.222.0.32 () {60 vars in 1456 bytes} [Thu Feb 10 03:42:57 2022] DELETE /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/os-volume_attachments/00fb88c8-b004-4720-b51b-10c2beef8c80 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:42:58.019690 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-54965019-624d-4e28-9295-2bf1b00a0367 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:42:58.020427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-54965019-624d-4e28-9295-2bf1b00a0367 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:58.027579 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54965019-624d-4e28-9295-2bf1b00a0367 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:58.028036 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54965019-624d-4e28-9295-2bf1b00a0367 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:58.028824 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54965019-624d-4e28-9295-2bf1b00a0367 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:58.029262 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54965019-624d-4e28-9295-2bf1b00a0367 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:58.111166 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b4e3ff9e-7da4-4119-8cf6-53320752fead tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:58.111955 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b4e3ff9e-7da4-4119-8cf6-53320752fead tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:58.119307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b4e3ff9e-7da4-4119-8cf6-53320752fead tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:58.119307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b4e3ff9e-7da4-4119-8cf6-53320752fead tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:58.119805 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b4e3ff9e-7da4-4119-8cf6-53320752fead tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:58.120438 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b4e3ff9e-7da4-4119-8cf6-53320752fead tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:58.120601 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-54965019-624d-4e28-9295-2bf1b00a0367 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "POST /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/action" status: 202 len: 0 microversion: 2.20 time: 0.104543 Feb 10 03:42:58.124239 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 439/865] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Feb 10 03:42:58 2022] POST /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:42:58.130938 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:58.132056 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:58.139774 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:58.140255 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:58.141187 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:58.141600 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:58.146773 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b4e3ff9e-7da4-4119-8cf6-53320752fead tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Going to try to terminate instance {{(pid=127951) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:42:58.249472 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b4e3ff9e-7da4-4119-8cf6-53320752fead tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 204 len: 0 microversion: 2.1 time: 0.141736 Feb 10 03:42:58.250876 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 427/866] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:42:58 2022] DELETE /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:42:58.261837 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-10032df3-f2b8-4eb3-a1b8-95b5aace991c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:58.262781 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-10032df3-f2b8-4eb3-a1b8-95b5aace991c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:58.270245 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-10032df3-f2b8-4eb3-a1b8-95b5aace991c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:58.270638 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-10032df3-f2b8-4eb3-a1b8-95b5aace991c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:58.271695 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-10032df3-f2b8-4eb3-a1b8-95b5aace991c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:58.272355 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-10032df3-f2b8-4eb3-a1b8-95b5aace991c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:58.289031 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:58.297779 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:58.299466 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:58.300622 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-70318574-ed62-4687-be0f-e0dcb5a9c8ee tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1670 microversion: 2.20 time: 0.173804 Feb 10 03:42:58.301187 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 440/867] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:58 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:58.669018 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-10032df3-f2b8-4eb3-a1b8-95b5aace991c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:58.676741 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-10032df3-f2b8-4eb3-a1b8-95b5aace991c tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1553 microversion: 2.1 time: 0.420500 Feb 10 03:42:58.677393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 428/868] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:58 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1553 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:42:59.319818 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:59.321054 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:59.328254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:59.329006 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:59.330304 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:59.340633 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:59.480909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:59.488714 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:59.490191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:59.491358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6055071b-a516-4d2d-ad4f-816aba9c84fb tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.175768 Feb 10 03:42:59.491911 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 441/869] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:42:59 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:42:59.693379 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-694c4ebf-0cbb-4bea-a6e2-9edcbc270e78 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:42:59.693973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-694c4ebf-0cbb-4bea-a6e2-9edcbc270e78 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:42:59.701274 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-694c4ebf-0cbb-4bea-a6e2-9edcbc270e78 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:59.701891 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-694c4ebf-0cbb-4bea-a6e2-9edcbc270e78 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:59.702948 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-694c4ebf-0cbb-4bea-a6e2-9edcbc270e78 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:42:59.703418 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-694c4ebf-0cbb-4bea-a6e2-9edcbc270e78 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:42:59.843754 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-694c4ebf-0cbb-4bea-a6e2-9edcbc270e78 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:42:59.851305 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-694c4ebf-0cbb-4bea-a6e2-9edcbc270e78 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1553 microversion: 2.1 time: 0.161681 Feb 10 03:42:59.851884 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 429/870] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:42:59 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:00.514322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:00.515318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:00.525861 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:00.526578 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:00.527384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:00.527814 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:00.673218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:00.684434 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:00.685923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:00.687155 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4ca4103d-57b2-451c-abf8-03bc23770a29 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.178819 Feb 10 03:43:00.687692 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 442/871] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:00 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:00.868730 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e3acd25e-7b0f-4e96-98e4-e5373e2239ad tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:00.869329 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e3acd25e-7b0f-4e96-98e4-e5373e2239ad tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:00.876143 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e3acd25e-7b0f-4e96-98e4-e5373e2239ad tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:00.876583 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e3acd25e-7b0f-4e96-98e4-e5373e2239ad tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:00.877348 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e3acd25e-7b0f-4e96-98e4-e5373e2239ad tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:00.877772 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e3acd25e-7b0f-4e96-98e4-e5373e2239ad tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:01.024938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e3acd25e-7b0f-4e96-98e4-e5373e2239ad tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:01.032424 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e3acd25e-7b0f-4e96-98e4-e5373e2239ad tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1553 microversion: 2.1 time: 0.167763 Feb 10 03:43:01.033355 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 430/872] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:00 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:43:01.708431 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:01.708973 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:01.715550 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:01.716000 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:01.716776 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:01.717201 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:01.853615 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:01.862027 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:01.863569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:01.864700 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c77c254b-dd4b-400b-a965-c5a8a04e4268 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.160161 Feb 10 03:43:01.865263 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 443/873] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:01 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:02.053454 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-763fdf50-1174-4b33-b4d9-e7030953dd02 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:02.054460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-763fdf50-1174-4b33-b4d9-e7030953dd02 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:02.062572 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-763fdf50-1174-4b33-b4d9-e7030953dd02 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:02.063141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-763fdf50-1174-4b33-b4d9-e7030953dd02 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:02.063897 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-763fdf50-1174-4b33-b4d9-e7030953dd02 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:02.064365 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-763fdf50-1174-4b33-b4d9-e7030953dd02 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:02.203978 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-763fdf50-1174-4b33-b4d9-e7030953dd02 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:02.212236 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-763fdf50-1174-4b33-b4d9-e7030953dd02 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1553 microversion: 2.1 time: 0.165161 Feb 10 03:43:02.212837 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 431/874] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:02 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:02.882502 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:02.883419 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:02.889865 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:02.890313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:02.891125 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:02.891559 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:03.032993 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:03.040868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:03.042338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:03.043675 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c463f564-1a82-40e8-8c05-a6f344f36881 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.164826 Feb 10 03:43:03.044270 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 444/875] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:02 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:03.236336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7d948ef7-af6c-4895-888e-08d632d8d0da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:03.236980 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7d948ef7-af6c-4895-888e-08d632d8d0da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:03.244291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7d948ef7-af6c-4895-888e-08d632d8d0da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:03.244929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7d948ef7-af6c-4895-888e-08d632d8d0da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:03.245971 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7d948ef7-af6c-4895-888e-08d632d8d0da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:03.246400 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7d948ef7-af6c-4895-888e-08d632d8d0da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:03.411492 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7d948ef7-af6c-4895-888e-08d632d8d0da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:03.419519 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7d948ef7-af6c-4895-888e-08d632d8d0da tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1553 microversion: 2.1 time: 0.187709 Feb 10 03:43:03.421408 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 432/876] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:03 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:03.702171 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-56a44d8a-286e-4e7b-a15b-5ec390586f8a req-5601d62e-a8eb-493b-8cbd-697fdca21336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a528a15b-6851-416c-9040-245fa3c93b88", "name": "network-vif-deleted", "tag": "21a54a32-023a-446a-a188-568375c7704d"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:43:03.704353 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:43:03.704353 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:43:03.712925 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-56a44d8a-286e-4e7b-a15b-5ec390586f8a req-5601d62e-a8eb-493b-8cbd-697fdca21336 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:03.713701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-56a44d8a-286e-4e7b-a15b-5ec390586f8a req-5601d62e-a8eb-493b-8cbd-697fdca21336 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:03.726161 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-56a44d8a-286e-4e7b-a15b-5ec390586f8a req-5601d62e-a8eb-493b-8cbd-697fdca21336 service nova] Creating event network-vif-deleted:21a54a32-023a-446a-a188-568375c7704d for instance a528a15b-6851-416c-9040-245fa3c93b88 on hv-cinder-82806 Feb 10 03:43:03.731994 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-56a44d8a-286e-4e7b-a15b-5ec390586f8a req-5601d62e-a8eb-493b-8cbd-697fdca21336 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034892 Feb 10 03:43:03.732848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 445/877] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:43:04.061650 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:04.062574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:04.068841 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:04.069298 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:04.070092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:04.070524 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:04.241735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:04.252609 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:04.254429 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:04.255799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-65f12308-7daf-4630-a53a-c62c1bf29169 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.198208 Feb 10 03:43:04.256446 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 433/878] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:04 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:04.438557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-98cf23b0-8ff2-40eb-8497-a21f6d5df8b4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:04.439336 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-98cf23b0-8ff2-40eb-8497-a21f6d5df8b4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:04.445775 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-98cf23b0-8ff2-40eb-8497-a21f6d5df8b4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:04.446254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-98cf23b0-8ff2-40eb-8497-a21f6d5df8b4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:04.447243 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-98cf23b0-8ff2-40eb-8497-a21f6d5df8b4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:04.447677 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-98cf23b0-8ff2-40eb-8497-a21f6d5df8b4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:04.510159 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-98cf23b0-8ff2-40eb-8497-a21f6d5df8b4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:04.517907 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-98cf23b0-8ff2-40eb-8497-a21f6d5df8b4 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1511 microversion: 2.1 time: 0.084010 Feb 10 03:43:04.523798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 446/879] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:04 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:05.274630 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:05.275684 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:05.286635 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:05.287250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:05.288142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:05.288792 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:05.431689 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:05.439360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:05.440829 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:05.442092 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-57c7d98f-d810-4eae-8888-98c955fc5434 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.171493 Feb 10 03:43:05.442663 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 434/880] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:05 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:05.536580 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a62525ac-7866-41a5-bbf9-df18d4ca872a tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:05.538109 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a62525ac-7866-41a5-bbf9-df18d4ca872a tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:05.559087 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a62525ac-7866-41a5-bbf9-df18d4ca872a tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:05.559543 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a62525ac-7866-41a5-bbf9-df18d4ca872a tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:05.560399 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a62525ac-7866-41a5-bbf9-df18d4ca872a tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:05.560825 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a62525ac-7866-41a5-bbf9-df18d4ca872a tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:05.625673 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a62525ac-7866-41a5-bbf9-df18d4ca872a tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:05.633349 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a62525ac-7866-41a5-bbf9-df18d4ca872a tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1511 microversion: 2.1 time: 0.101802 Feb 10 03:43:05.633909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 447/881] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:05 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:06.462021 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:06.463430 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:06.471011 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:06.471470 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:06.472290 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:06.472731 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:06.622447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:06.630279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:06.631853 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:06.633067 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f21710b1-3313-48b2-ab50-f78708e93162 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.176172 Feb 10 03:43:06.633641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 435/882] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:06 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:06.650335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5fa0aaee-15f3-47be-a5cc-f9b356426a1e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:06.650976 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5fa0aaee-15f3-47be-a5cc-f9b356426a1e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:06.657457 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5fa0aaee-15f3-47be-a5cc-f9b356426a1e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:06.657887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5fa0aaee-15f3-47be-a5cc-f9b356426a1e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:06.658694 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5fa0aaee-15f3-47be-a5cc-f9b356426a1e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:06.659143 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5fa0aaee-15f3-47be-a5cc-f9b356426a1e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:06.724748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5fa0aaee-15f3-47be-a5cc-f9b356426a1e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:06.733676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5fa0aaee-15f3-47be-a5cc-f9b356426a1e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1511 microversion: 2.1 time: 0.086962 Feb 10 03:43:06.734548 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 448/883] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:06 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:07.656745 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:07.659400 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:07.672744 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:07.673632 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:07.674806 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:07.675769 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:07.751986 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0c4d3137-201c-4684-88b1-9ccc68bb3489 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:07.753591 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0c4d3137-201c-4684-88b1-9ccc68bb3489 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:07.760845 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0c4d3137-201c-4684-88b1-9ccc68bb3489 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:07.761638 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0c4d3137-201c-4684-88b1-9ccc68bb3489 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:07.762949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0c4d3137-201c-4684-88b1-9ccc68bb3489 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:07.763553 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0c4d3137-201c-4684-88b1-9ccc68bb3489 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:07.835983 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-0c4d3137-201c-4684-88b1-9ccc68bb3489 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:07.843413 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0c4d3137-201c-4684-88b1-9ccc68bb3489 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1511 microversion: 2.1 time: 0.095576 Feb 10 03:43:07.844011 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 449/884] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:07 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:43:07.870154 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:07.878133 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:07.879679 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:07.880848 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4ac8e028-ba0f-4c71-bde6-7a70b22d73fd tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.232156 Feb 10 03:43:07.881415 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 436/885] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:07 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:08.860811 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3048af21-ec3f-4a32-a253-d384167cfea6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:08.861557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3048af21-ec3f-4a32-a253-d384167cfea6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:08.868573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3048af21-ec3f-4a32-a253-d384167cfea6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:08.869025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3048af21-ec3f-4a32-a253-d384167cfea6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:08.869798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3048af21-ec3f-4a32-a253-d384167cfea6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:08.870253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3048af21-ec3f-4a32-a253-d384167cfea6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:08.899118 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:08.899757 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:08.906527 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:08.907034 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:08.907819 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:08.908296 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:08.932131 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3048af21-ec3f-4a32-a253-d384167cfea6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:08.941183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3048af21-ec3f-4a32-a253-d384167cfea6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1511 microversion: 2.1 time: 0.083900 Feb 10 03:43:08.942538 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 450/886] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:08 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:09.070393 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:09.079028 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:09.080854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:09.082019 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-15001a14-efef-4297-9267-845b7f9fe591 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.186767 Feb 10 03:43:09.082805 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 437/887] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:08 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:09.958889 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-666184d7-4edd-4f70-a93b-59f857b31b73 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:09.959496 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-666184d7-4edd-4f70-a93b-59f857b31b73 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:09.966279 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-666184d7-4edd-4f70-a93b-59f857b31b73 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:09.966754 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-666184d7-4edd-4f70-a93b-59f857b31b73 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:09.967539 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-666184d7-4edd-4f70-a93b-59f857b31b73 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:09.967970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-666184d7-4edd-4f70-a93b-59f857b31b73 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:10.036852 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-666184d7-4edd-4f70-a93b-59f857b31b73 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:10.044918 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-666184d7-4edd-4f70-a93b-59f857b31b73 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1511 microversion: 2.1 time: 0.089645 Feb 10 03:43:10.045463 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 451/888] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:09 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:10.102688 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:10.103571 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:10.112806 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:10.113895 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:10.115445 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:10.116368 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:10.257131 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:10.267976 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:10.270191 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:10.271710 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ead71aa2-622a-4e03-b108-ad834050a99d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.174631 Feb 10 03:43:10.282325 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 438/889] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:10 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:11.063736 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b9fdce1c-cba4-43f9-9730-399658a244a6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:11.066223 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b9fdce1c-cba4-43f9-9730-399658a244a6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:11.073337 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b9fdce1c-cba4-43f9-9730-399658a244a6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:11.074211 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b9fdce1c-cba4-43f9-9730-399658a244a6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:11.075748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b9fdce1c-cba4-43f9-9730-399658a244a6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:11.076427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b9fdce1c-cba4-43f9-9730-399658a244a6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:11.153950 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b9fdce1c-cba4-43f9-9730-399658a244a6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:11.166626 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b9fdce1c-cba4-43f9-9730-399658a244a6 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1511 microversion: 2.1 time: 0.108349 Feb 10 03:43:11.167311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 452/890] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:11 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1511 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:11.289340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:11.290006 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:11.298214 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:11.299076 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:11.300665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:11.301553 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:11.452537 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:11.460606 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:11.462125 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:11.463289 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-550c2a1d-4667-489b-9c63-d4c34760ea15 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.177769 Feb 10 03:43:11.463864 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 439/891] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:11 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:12.186342 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-54fefced-8a95-4c1d-af16-ccd72c705e2e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:12.188077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-54fefced-8a95-4c1d-af16-ccd72c705e2e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:12.195929 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54fefced-8a95-4c1d-af16-ccd72c705e2e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:12.196714 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54fefced-8a95-4c1d-af16-ccd72c705e2e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:12.197730 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54fefced-8a95-4c1d-af16-ccd72c705e2e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:12.198424 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-54fefced-8a95-4c1d-af16-ccd72c705e2e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:12.270283 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-54fefced-8a95-4c1d-af16-ccd72c705e2e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:12.281580 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-54fefced-8a95-4c1d-af16-ccd72c705e2e tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1511 microversion: 2.1 time: 0.100197 Feb 10 03:43:12.282856 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 453/892] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:12 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:12.489657 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:12.490451 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:12.497697 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:12.498402 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:12.499413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:12.500014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:12.641354 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:12.649147 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:12.650711 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:12.651843 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bd01c836-7b11-4273-b695-2bff91e94d3c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.174131 Feb 10 03:43:12.652411 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 440/893] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:12 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:13.299309 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-62631571-86ff-48ce-944d-235bfc3266d0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:13.299895 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-62631571-86ff-48ce-944d-235bfc3266d0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:13.305802 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-62631571-86ff-48ce-944d-235bfc3266d0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:13.306276 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-62631571-86ff-48ce-944d-235bfc3266d0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:13.307073 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-62631571-86ff-48ce-944d-235bfc3266d0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:13.307504 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-62631571-86ff-48ce-944d-235bfc3266d0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:13.376887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-62631571-86ff-48ce-944d-235bfc3266d0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3117cb6d65454365be315814d9d696cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d44d08ec564e94b99156087796bf3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:13.386311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-62631571-86ff-48ce-944d-235bfc3266d0 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 200 len: 1343 microversion: 2.1 time: 0.090642 Feb 10 03:43:13.387311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 454/894] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:13 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 1343 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:13.673113 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:13.673934 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:13.682833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:13.683477 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:13.684566 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:13.685143 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:13.835963 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:13.845170 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:13.847571 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:13.848743 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ebcfdc4e-0491-4069-8219-f817e21d31ed tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.181247 Feb 10 03:43:13.849307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 441/895] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:13 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:14.408505 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:14.409371 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] [instance: a528a15b-6851-416c-9040-245fa3c93b88] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:14.419688 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:14.420134 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:14.420913 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:14.421342 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:14.434850 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] HTTP exception thrown: Instance a528a15b-6851-416c-9040-245fa3c93b88 could not be found. Feb 10 03:43:14.435427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Returning 404 to user: Instance a528a15b-6851-416c-9040-245fa3c93b88 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:43:14.436222 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ecfed0e7-eee1-45f3-bb5b-505c769efa41 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88" status: 404 len: 111 microversion: 2.1 time: 0.034267 Feb 10 03:43:14.436726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 455/896] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:14 2022] GET /compute/v2.1/servers/a528a15b-6851-416c-9040-245fa3c93b88 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:43:14.444888 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dac55f71-b7d6-4fe6-a6ee-227826046020 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] Calling method '.version_select at 0x7fe95a329160>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:14.464752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dac55f71-b7d6-4fe6-a6ee-227826046020 tempest-TestMinimumBasicScenario-1901763929 tempest-TestMinimumBasicScenario-1901763929-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900309155" status: 202 len: 0 microversion: 2.1 time: 0.023532 Feb 10 03:43:14.465394 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 442/897] 10.222.0.32 () {58 vars in 1268 bytes} [Thu Feb 10 03:43:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-900309155 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:43:14.867582 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:14.868543 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:14.875027 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:14.875475 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:14.876251 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:14.876676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:15.012464 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:15.020571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:15.022075 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:15.023257 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-74bf2765-dd84-4b4e-bc5d-a270897a1c6c tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.159575 Feb 10 03:43:15.023843 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 456/898] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:14 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:16.041281 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:16.041889 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:16.049592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:16.050273 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:16.051576 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:16.052012 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:16.221611 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:16.229978 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:16.231705 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:16.233097 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c0af0f2a-c5de-4e6d-953b-f77e39cf9952 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.195616 Feb 10 03:43:16.233688 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 443/899] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:16 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:17.252010 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:17.253504 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:17.260151 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:17.260649 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:17.261506 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:17.261983 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:17.399865 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:17.407670 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:17.409184 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:17.410339 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b116f6b3-b1aa-40c7-857d-faf88d664fd3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.162880 Feb 10 03:43:17.410920 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 457/900] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:17 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:18.428828 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:18.429397 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:18.435929 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:18.436382 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:18.437165 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:18.437599 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:18.689714 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:18.698145 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:18.699733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:18.701129 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f646fca0-4369-48d1-b49f-673f45095291 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.276101 Feb 10 03:43:18.701791 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 444/901] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:18 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:19.720674 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:19.721368 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:19.728034 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:19.728560 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:19.729489 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:19.730059 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:19.981154 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:19.989680 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:19.991177 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:19.992313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f4503d0a-df39-4a58-8bb7-a844b5c58651 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.275544 Feb 10 03:43:19.993204 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 458/902] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:19 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:43:20.412912 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-0eda7dd2-8870-4a32-88b7-8f78a212a00e req-3edd7a1d-775b-4e08-bfd5-0210e07e3e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68175f5a-583d-43b3-a6f6-3b045303c1d1", "name": "network-vif-plugged", "status": "completed", "tag": "dd4ed260-10d2-4b11-ae4a-2e37c7f81db6"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:43:20.414464 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:43:20.414464 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:43:20.429229 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-0eda7dd2-8870-4a32-88b7-8f78a212a00e req-3edd7a1d-775b-4e08-bfd5-0210e07e3e0f service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:20.429686 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-0eda7dd2-8870-4a32-88b7-8f78a212a00e req-3edd7a1d-775b-4e08-bfd5-0210e07e3e0f service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:20.440955 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-0eda7dd2-8870-4a32-88b7-8f78a212a00e req-3edd7a1d-775b-4e08-bfd5-0210e07e3e0f service nova] Creating event network-vif-plugged:dd4ed260-10d2-4b11-ae4a-2e37c7f81db6 for instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 on hv-cinder-82806 Feb 10 03:43:20.452243 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-0eda7dd2-8870-4a32-88b7-8f78a212a00e req-3edd7a1d-775b-4e08-bfd5-0210e07e3e0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042764 Feb 10 03:43:20.453122 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 445/903] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:43:21.011248 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:21.012022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:21.018870 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:21.019509 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:21.020357 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:21.020862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:21.254806 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:21.263439 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:21.264940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:21.266114 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-fdee6ec2-8124-437a-a0ac-2b6e67176384 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.258644 Feb 10 03:43:21.266733 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 459/904] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:21 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:22.284672 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:22.285649 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:22.292039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:22.292482 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:22.293255 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:22.293681 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:22.449097 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:22.458062 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:22.459665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:22.460918 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dec95f52-5584-4a46-9722-eb320f05a6f3 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1728 microversion: 2.20 time: 0.181020 Feb 10 03:43:22.461543 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 446/905] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:22 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:23.479134 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:23.480401 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:23.490521 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:23.491293 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:23.492467 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:23.493533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:23.636950 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:23.646002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:23.647474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:23.648637 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e3d630a2-bc3a-4824-9c0a-e0b62f1df89d tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1715 microversion: 2.20 time: 0.173323 Feb 10 03:43:23.649188 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 460/906] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:43:23 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1715 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:43:24.822506 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7e013a61-a0f9-4b0c-af07-54c82610a049 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:24.823069 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7e013a61-a0f9-4b0c-af07-54c82610a049 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:24.829584 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e013a61-a0f9-4b0c-af07-54c82610a049 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:24.830269 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e013a61-a0f9-4b0c-af07-54c82610a049 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:24.831385 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e013a61-a0f9-4b0c-af07-54c82610a049 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:24.831998 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e013a61-a0f9-4b0c-af07-54c82610a049 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:24.866853 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7e013a61-a0f9-4b0c-af07-54c82610a049 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/725c5ad3-a318-40d4-b0a0-31328bb51223" status: 200 len: 194 microversion: 2.1 time: 0.048268 Feb 10 03:43:24.867699 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 447/907] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Feb 10 03:43:24 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/725c5ad3-a318-40d4-b0a0-31328bb51223 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:43:24.878095 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f219f83b-fdd0-406c-ad32-310e1153118d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:24.878671 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f219f83b-fdd0-406c-ad32-310e1153118d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:24.885430 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f219f83b-fdd0-406c-ad32-310e1153118d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:24.886577 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f219f83b-fdd0-406c-ad32-310e1153118d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:24.887464 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f219f83b-fdd0-406c-ad32-310e1153118d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:24.887996 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f219f83b-fdd0-406c-ad32-310e1153118d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:24.979909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-f219f83b-fdd0-406c-ad32-310e1153118d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lazy-loading 'services' on Instance uuid 2a602fde-ab06-459f-83dc-10ee456f77e5 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:43:25.081748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f219f83b-fdd0-406c-ad32-310e1153118d tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/725c5ad3-a318-40d4-b0a0-31328bb51223" status: 202 len: 0 microversion: 2.1 time: 0.207447 Feb 10 03:43:25.082904 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 461/908] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:43:24 2022] DELETE /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/725c5ad3-a318-40d4-b0a0-31328bb51223 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:43:27.311460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a82d094e-55f8-4636-911a-51d38f901102 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:27.312180 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a82d094e-55f8-4636-911a-51d38f901102 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:27.318705 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a82d094e-55f8-4636-911a-51d38f901102 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:27.319161 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a82d094e-55f8-4636-911a-51d38f901102 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:27.321661 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a82d094e-55f8-4636-911a-51d38f901102 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:27.322398 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a82d094e-55f8-4636-911a-51d38f901102 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:27.358720 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a82d094e-55f8-4636-911a-51d38f901102 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/f294dc82-2bde-4a25-8890-73bfc8c274d5" status: 200 len: 194 microversion: 2.1 time: 0.051184 Feb 10 03:43:27.359427 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 448/909] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Feb 10 03:43:27 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/f294dc82-2bde-4a25-8890-73bfc8c274d5 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:43:27.370258 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-17f011b4-46ab-4edc-82cb-468a438d2868 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:27.371023 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-17f011b4-46ab-4edc-82cb-468a438d2868 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:27.378337 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17f011b4-46ab-4edc-82cb-468a438d2868 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:27.379206 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17f011b4-46ab-4edc-82cb-468a438d2868 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:27.379998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17f011b4-46ab-4edc-82cb-468a438d2868 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:27.380431 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17f011b4-46ab-4edc-82cb-468a438d2868 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:27.465333 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-17f011b4-46ab-4edc-82cb-468a438d2868 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lazy-loading 'services' on Instance uuid 2a602fde-ab06-459f-83dc-10ee456f77e5 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:43:27.543099 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-17f011b4-46ab-4edc-82cb-468a438d2868 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/f294dc82-2bde-4a25-8890-73bfc8c274d5" status: 202 len: 0 microversion: 2.1 time: 0.177228 Feb 10 03:43:27.544390 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 462/910] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:43:27 2022] DELETE /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments/f294dc82-2bde-4a25-8890-73bfc8c274d5 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:43:28.744404 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e5f6cb21-b2d8-4efc-bdc4-bca42b77ec87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:28.745578 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e5f6cb21-b2d8-4efc-bdc4-bca42b77ec87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:28.752756 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e5f6cb21-b2d8-4efc-bdc4-bca42b77ec87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:28.753212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e5f6cb21-b2d8-4efc-bdc4-bca42b77ec87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:28.754012 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e5f6cb21-b2d8-4efc-bdc4-bca42b77ec87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:28.754432 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e5f6cb21-b2d8-4efc-bdc4-bca42b77ec87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:28.790842 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e5f6cb21-b2d8-4efc-bdc4-bca42b77ec87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051048 Feb 10 03:43:28.792442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 449/911] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:43:28 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:43:28.908175 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3af8a507-0e75-417b-a10e-ea0c9f0981fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:28.909823 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3af8a507-0e75-417b-a10e-ea0c9f0981fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:28.916388 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3af8a507-0e75-417b-a10e-ea0c9f0981fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:28.917096 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3af8a507-0e75-417b-a10e-ea0c9f0981fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:28.917880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3af8a507-0e75-417b-a10e-ea0c9f0981fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:28.918310 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3af8a507-0e75-417b-a10e-ea0c9f0981fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:28.949255 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3af8a507-0e75-417b-a10e-ea0c9f0981fd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045877 Feb 10 03:43:28.950160 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 463/912] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Feb 10 03:43:28 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 10 03:43:29.009408 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3ae5e61a-e137-4f99-9a27-07fab71b8497 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:29.010303 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3ae5e61a-e137-4f99-9a27-07fab71b8497 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:29.021809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ae5e61a-e137-4f99-9a27-07fab71b8497 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:29.022752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ae5e61a-e137-4f99-9a27-07fab71b8497 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:29.023958 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ae5e61a-e137-4f99-9a27-07fab71b8497 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:29.024489 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3ae5e61a-e137-4f99-9a27-07fab71b8497 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:29.052362 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3ae5e61a-e137-4f99-9a27-07fab71b8497 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Going to try to terminate instance {{(pid=127951) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:43:29.148922 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3ae5e61a-e137-4f99-9a27-07fab71b8497 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 204 len: 0 microversion: 2.1 time: 0.144251 Feb 10 03:43:29.153073 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 450/913] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:43:29 2022] DELETE /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:43:29.158530 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-854c17d3-df11-4185-bbef-57d442a10c87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:29.159702 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-854c17d3-df11-4185-bbef-57d442a10c87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:29.167850 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-854c17d3-df11-4185-bbef-57d442a10c87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:29.168465 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-854c17d3-df11-4185-bbef-57d442a10c87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:29.169470 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-854c17d3-df11-4185-bbef-57d442a10c87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:29.170253 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-854c17d3-df11-4185-bbef-57d442a10c87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:29.465787 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-854c17d3-df11-4185-bbef-57d442a10c87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:29.473913 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-854c17d3-df11-4185-bbef-57d442a10c87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1673 microversion: 2.1 time: 0.319264 Feb 10 03:43:29.474473 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 464/914] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:29 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1673 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:30.494540 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d8b31fc4-9005-45b5-9bd2-404a88d77b87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:30.495976 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d8b31fc4-9005-45b5-9bd2-404a88d77b87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:30.535874 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d8b31fc4-9005-45b5-9bd2-404a88d77b87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:30.536830 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d8b31fc4-9005-45b5-9bd2-404a88d77b87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:30.537948 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d8b31fc4-9005-45b5-9bd2-404a88d77b87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:30.538532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d8b31fc4-9005-45b5-9bd2-404a88d77b87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:30.839154 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d8b31fc4-9005-45b5-9bd2-404a88d77b87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:30.855574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d8b31fc4-9005-45b5-9bd2-404a88d77b87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1673 microversion: 2.1 time: 0.367707 Feb 10 03:43:30.856457 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 451/915] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:30 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1673 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:31.872291 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6fc8c80d-a5d5-4cf8-87e0-e3a0f220f354 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:31.873628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6fc8c80d-a5d5-4cf8-87e0-e3a0f220f354 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:31.893620 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6fc8c80d-a5d5-4cf8-87e0-e3a0f220f354 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:31.894345 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6fc8c80d-a5d5-4cf8-87e0-e3a0f220f354 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:31.895327 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6fc8c80d-a5d5-4cf8-87e0-e3a0f220f354 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:31.895990 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6fc8c80d-a5d5-4cf8-87e0-e3a0f220f354 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:31.981899 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6fc8c80d-a5d5-4cf8-87e0-e3a0f220f354 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:31.991329 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6fc8c80d-a5d5-4cf8-87e0-e3a0f220f354 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1606 microversion: 2.1 time: 0.122530 Feb 10 03:43:31.996289 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 465/916] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:31 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1606 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:32.421043 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-d18850cb-6869-41ba-8f17-4014a3767a51 req-b5d7dc37-832f-475f-a6e7-c31198e5aaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a602fde-ab06-459f-83dc-10ee456f77e5", "name": "network-vif-deleted", "tag": "55725b88-e980-424f-91f6-78757fc06a2a"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:43:32.422712 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:43:32.422712 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:43:32.435385 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-d18850cb-6869-41ba-8f17-4014a3767a51 req-b5d7dc37-832f-475f-a6e7-c31198e5aaaa service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:32.437277 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-d18850cb-6869-41ba-8f17-4014a3767a51 req-b5d7dc37-832f-475f-a6e7-c31198e5aaaa service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:32.465546 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-d18850cb-6869-41ba-8f17-4014a3767a51 req-b5d7dc37-832f-475f-a6e7-c31198e5aaaa service nova] Creating event network-vif-deleted:55725b88-e980-424f-91f6-78757fc06a2a for instance 2a602fde-ab06-459f-83dc-10ee456f77e5 on hv-cinder-82806 Feb 10 03:43:32.489634 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-d18850cb-6869-41ba-8f17-4014a3767a51 req-b5d7dc37-832f-475f-a6e7-c31198e5aaaa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074651 Feb 10 03:43:32.493939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 452/917] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:43:33.012978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:33.014986 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:33.027303 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:33.028280 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:33.029603 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:33.030402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:33.070467 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:33.071701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:33.072621 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lazy-loading 'fault' on Instance uuid 2a602fde-ab06-459f-83dc-10ee456f77e5 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:43:33.183384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1ef6f6170f4ccb9e3b439ac3fd56e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f327fcae4b024948a911ad1bdeb06ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:33.191761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-04439a83-8e39-4775-b0f9-edc29985ae87 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 200 len: 1328 microversion: 2.1 time: 0.182611 Feb 10 03:43:33.203088 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 466/918] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:33 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 1328 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:33.861219 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2087c974-e1a6-4495-92b6-f60e9ac70d1a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Action: 'create', calling method: .version_select at 0x7fe95a28a0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1741087814"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:43:33.875394 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-2087c974-e1a6-4495-92b6-f60e9ac70d1a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Getting quotas for project 69a1b85d278c49969a6a638dd37579d6. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:43:33.879268 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-2087c974-e1a6-4495-92b6-f60e9ac70d1a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Getting quotas for user 87291059637f46ca8985768611d1acf5 and project 69a1b85d278c49969a6a638dd37579d6. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:43:34.020909 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-2087c974-e1a6-4495-92b6-f60e9ac70d1a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Getting quotas for project 69a1b85d278c49969a6a638dd37579d6. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:43:34.024764 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-2087c974-e1a6-4495-92b6-f60e9ac70d1a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Getting quotas for user 87291059637f46ca8985768611d1acf5 and project 69a1b85d278c49969a6a638dd37579d6. Resources: {'key_pairs'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:43:34.038409 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2087c974-e1a6-4495-92b6-f60e9ac70d1a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.335933 Feb 10 03:43:34.039114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 453/919] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Feb 10 03:43:33 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:34.211591 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:34.216670 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:34.237772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:34.238250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:34.239116 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:34.239547 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:34.257712 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] HTTP exception thrown: Instance 2a602fde-ab06-459f-83dc-10ee456f77e5 could not be found. Feb 10 03:43:34.258306 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Returning 404 to user: Instance 2a602fde-ab06-459f-83dc-10ee456f77e5 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:43:34.259358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-92a017a8-53cf-441a-a449-0e518d3de459 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 404 len: 111 microversion: 2.1 time: 0.053804 Feb 10 03:43:34.259916 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 467/920] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:34 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:43:34.268628 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-21c2bb2e-6f8e-4a49-94ad-864951ef9b3c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '.version_select at 0x7fe95a2bfaf0>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:34.292088 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-21c2bb2e-6f8e-4a49-94ad-864951ef9b3c tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116660292" status: 202 len: 0 microversion: 2.1 time: 0.027227 Feb 10 03:43:34.292952 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 454/921] 10.222.0.32 () {58 vars in 1220 bytes} [Thu Feb 10 03:43:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116660292 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:43:37.403479 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:37.404568 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:37.410837 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:37.411293 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:37.412204 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:37.412647 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:37.427237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] HTTP exception thrown: Instance 2a602fde-ab06-459f-83dc-10ee456f77e5 could not be found. Feb 10 03:43:37.428093 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Returning 404 to user: Instance 2a602fde-ab06-459f-83dc-10ee456f77e5 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:43:37.428890 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-760edeb3-aba6-46b9-bf63-b90d6b774128 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 404 len: 111 microversion: 2.1 time: 0.029455 Feb 10 03:43:37.429932 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 468/922] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:43:37 2022] DELETE /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:43:37.437575 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:37.438309 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: 2a602fde-ab06-459f-83dc-10ee456f77e5] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:37.445690 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:37.446350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:37.447180 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:37.447622 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:37.460752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] HTTP exception thrown: Instance 2a602fde-ab06-459f-83dc-10ee456f77e5 could not be found. Feb 10 03:43:37.461353 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Returning 404 to user: Instance 2a602fde-ab06-459f-83dc-10ee456f77e5 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:43:37.462171 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0d5665fe-c90b-46c3-865a-bac1b40d2cfd tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5" status: 404 len: 111 microversion: 2.1 time: 0.028426 Feb 10 03:43:37.462858 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 455/923] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:37 2022] GET /compute/v2.1/servers/2a602fde-ab06-459f-83dc-10ee456f77e5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 10 03:43:38.597448 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:38.598345 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:38.606378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:38.607074 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:38.608487 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:38.609295 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:38.623198 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] HTTP exception thrown: Instance d60b46a9-24cb-430f-83bd-3c74a87a08cd could not be found. Feb 10 03:43:38.623927 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Returning 404 to user: Instance d60b46a9-24cb-430f-83bd-3c74a87a08cd could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:43:38.624745 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-384263bc-d108-454a-a6da-e625f3166aa7 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 404 len: 111 microversion: 2.1 time: 0.032035 Feb 10 03:43:38.625279 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 469/924] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:43:38 2022] DELETE /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:43:38.636253 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:38.637110 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] [instance: d60b46a9-24cb-430f-83bd-3c74a87a08cd] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:38.647053 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:38.647685 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:38.648859 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:38.649504 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:38.664592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] HTTP exception thrown: Instance d60b46a9-24cb-430f-83bd-3c74a87a08cd could not be found. Feb 10 03:43:38.665159 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] Returning 404 to user: Instance d60b46a9-24cb-430f-83bd-3c74a87a08cd could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:43:38.665956 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c665be38-1944-40c8-8f99-f760bb75d9c4 tempest-AttachVolumeTestJSON-1186501723 tempest-AttachVolumeTestJSON-1186501723-project] 10.222.0.32 "GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd" status: 404 len: 111 microversion: 2.1 time: 0.035872 Feb 10 03:43:38.666463 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 456/925] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:38 2022] GET /compute/v2.1/servers/d60b46a9-24cb-430f-83bd-3c74a87a08cd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:43:52.444729 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1017978221", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1741087814", "security_groups": [{"name": "tempest-secgroup-smoke-1318955137"}], "networks": [{"uuid": "141657dd-0a9d-419e-8e9a-229883dc970c"}], "block_device_mapping_v2": [{"uuid": "ce8d71d4-fb89-4013-85b9-b1aad49f32a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:43:52.571215 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] validate_networks() for [('141657dd-0a9d-419e-8e9a-229883dc970c', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:43:52.941892 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:43:52.942302 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:43:52.942888 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:43:52.943347 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:43:52.943786 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:43:52.952998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:52.953443 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:52.954232 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:52.954678 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:52.970602 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Getting quotas for project 69a1b85d278c49969a6a638dd37579d6. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:43:52.974407 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Getting quotas for user 87291059637f46ca8985768611d1acf5 and project 69a1b85d278c49969a6a638dd37579d6. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:43:53.028187 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:43:53.030307 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce8d71d4-fb89-4013-85b9-b1aad49f32a2',volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:43:53.166596 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c97cfef2-cbac-4d90-a976-0807ef3cc95d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726423 Feb 10 03:43:53.174721 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 470/926] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:43:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:43:53.179652 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-ef3139f7-8e17-4d44-a99e-e07a2a8377cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:53.180330 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-ef3139f7-8e17-4d44-a99e-e07a2a8377cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:53.237291 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-ef3139f7-8e17-4d44-a99e-e07a2a8377cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:53.244519 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-ef3139f7-8e17-4d44-a99e-e07a2a8377cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1089 microversion: 2.1 time: 0.068705 Feb 10 03:43:53.245268 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 457/927] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:53 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:43:54.262840 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-aa43a19f-ce58-47a7-9f13-8c18f7be67cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:54.263505 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-aa43a19f-ce58-47a7-9f13-8c18f7be67cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:54.271228 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aa43a19f-ce58-47a7-9f13-8c18f7be67cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:54.271794 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aa43a19f-ce58-47a7-9f13-8c18f7be67cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:54.272643 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aa43a19f-ce58-47a7-9f13-8c18f7be67cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:54.273138 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-aa43a19f-ce58-47a7-9f13-8c18f7be67cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:54.336310 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-aa43a19f-ce58-47a7-9f13-8c18f7be67cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:54.343667 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-aa43a19f-ce58-47a7-9f13-8c18f7be67cf tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1205 microversion: 2.1 time: 0.085531 Feb 10 03:43:54.353263 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 471/928] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:54 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1205 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:55.360995 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-934cd73f-d774-42d4-be93-cb507e9e9de7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:55.361572 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-934cd73f-d774-42d4-be93-cb507e9e9de7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:55.369302 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-934cd73f-d774-42d4-be93-cb507e9e9de7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:55.369741 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-934cd73f-d774-42d4-be93-cb507e9e9de7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:55.370519 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-934cd73f-d774-42d4-be93-cb507e9e9de7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:55.370976 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-934cd73f-d774-42d4-be93-cb507e9e9de7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:55.523658 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-934cd73f-d774-42d4-be93-cb507e9e9de7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:55.531311 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-934cd73f-d774-42d4-be93-cb507e9e9de7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.174114 Feb 10 03:43:55.532158 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 458/929] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:55 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:55.612318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-ac60eb9f-d71b-4945-a161-19e598a62475 req-958d0fd5-13c7-4383-a7c9-7178215bb11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc16f9d-92be-495d-abdf-9357e248264d", "tag": "f1a017bb-b64b-41fc-802b-4d4964557ece"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:43:55.620172 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:43:55.620172 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:43:55.635500 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-ac60eb9f-d71b-4945-a161-19e598a62475 req-958d0fd5-13c7-4383-a7c9-7178215bb11f service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:55.636804 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-ac60eb9f-d71b-4945-a161-19e598a62475 req-958d0fd5-13c7-4383-a7c9-7178215bb11f service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:55.649265 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-ac60eb9f-d71b-4945-a161-19e598a62475 req-958d0fd5-13c7-4383-a7c9-7178215bb11f service nova] Creating event network-changed:f1a017bb-b64b-41fc-802b-4d4964557ece for instance 1bc16f9d-92be-495d-abdf-9357e248264d on hv-cinder-82806 Feb 10 03:43:55.654251 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-ac60eb9f-d71b-4945-a161-19e598a62475 req-958d0fd5-13c7-4383-a7c9-7178215bb11f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045527 Feb 10 03:43:55.654948 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 472/930] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:43:56.550203 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-373b40be-ad7d-4062-9fd0-33c61a5b75d8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:56.550817 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-373b40be-ad7d-4062-9fd0-33c61a5b75d8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:56.559087 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-373b40be-ad7d-4062-9fd0-33c61a5b75d8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:56.559748 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-373b40be-ad7d-4062-9fd0-33c61a5b75d8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:56.560539 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-373b40be-ad7d-4062-9fd0-33c61a5b75d8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:56.561042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-373b40be-ad7d-4062-9fd0-33c61a5b75d8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:56.701825 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-373b40be-ad7d-4062-9fd0-33c61a5b75d8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:56.712069 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-373b40be-ad7d-4062-9fd0-33c61a5b75d8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.166927 Feb 10 03:43:56.712729 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 459/931] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:56 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:57.729314 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a190f0c9-178e-4e52-88ba-9ee94732cb81 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:57.730040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a190f0c9-178e-4e52-88ba-9ee94732cb81 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:57.736661 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a190f0c9-178e-4e52-88ba-9ee94732cb81 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:57.737115 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a190f0c9-178e-4e52-88ba-9ee94732cb81 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:57.737896 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a190f0c9-178e-4e52-88ba-9ee94732cb81 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:57.738336 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a190f0c9-178e-4e52-88ba-9ee94732cb81 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:57.876754 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a190f0c9-178e-4e52-88ba-9ee94732cb81 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:57.884740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a190f0c9-178e-4e52-88ba-9ee94732cb81 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.160180 Feb 10 03:43:57.885400 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 473/932] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:57 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:43:58.904125 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b5fc12bf-70fa-4094-9696-732c3b7fa343 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:43:58.904718 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b5fc12bf-70fa-4094-9696-732c3b7fa343 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:43:58.910932 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b5fc12bf-70fa-4094-9696-732c3b7fa343 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:58.911371 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b5fc12bf-70fa-4094-9696-732c3b7fa343 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:58.912183 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b5fc12bf-70fa-4094-9696-732c3b7fa343 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:43:58.912680 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b5fc12bf-70fa-4094-9696-732c3b7fa343 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:43:59.054790 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b5fc12bf-70fa-4094-9696-732c3b7fa343 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:43:59.062201 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b5fc12bf-70fa-4094-9696-732c3b7fa343 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.162948 Feb 10 03:43:59.063089 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 460/933] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:43:58 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:00.081271 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-cfd9dae6-5c28-4ef3-a003-a55fb2ef39f4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:00.082896 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-cfd9dae6-5c28-4ef3-a003-a55fb2ef39f4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:00.091608 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cfd9dae6-5c28-4ef3-a003-a55fb2ef39f4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:00.092207 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cfd9dae6-5c28-4ef3-a003-a55fb2ef39f4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:00.093250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cfd9dae6-5c28-4ef3-a003-a55fb2ef39f4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:00.093836 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-cfd9dae6-5c28-4ef3-a003-a55fb2ef39f4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:00.251650 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-cfd9dae6-5c28-4ef3-a003-a55fb2ef39f4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:00.260049 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-cfd9dae6-5c28-4ef3-a003-a55fb2ef39f4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.183788 Feb 10 03:44:00.260610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 474/934] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:00 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:01.276130 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-291d8347-4ac2-46fa-a362-c07525a56ef2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:01.276782 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-291d8347-4ac2-46fa-a362-c07525a56ef2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:01.284451 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-291d8347-4ac2-46fa-a362-c07525a56ef2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:01.285302 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-291d8347-4ac2-46fa-a362-c07525a56ef2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:01.286460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-291d8347-4ac2-46fa-a362-c07525a56ef2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:01.287022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-291d8347-4ac2-46fa-a362-c07525a56ef2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:01.433667 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-291d8347-4ac2-46fa-a362-c07525a56ef2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:01.441049 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-291d8347-4ac2-46fa-a362-c07525a56ef2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.168791 Feb 10 03:44:01.441936 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 461/935] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:01 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:02.458194 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-798fe05f-b82b-4e5e-acb3-68e2cbb6c429 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:02.458964 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-798fe05f-b82b-4e5e-acb3-68e2cbb6c429 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:02.467098 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-798fe05f-b82b-4e5e-acb3-68e2cbb6c429 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:02.467586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-798fe05f-b82b-4e5e-acb3-68e2cbb6c429 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:02.468359 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-798fe05f-b82b-4e5e-acb3-68e2cbb6c429 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:02.468796 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-798fe05f-b82b-4e5e-acb3-68e2cbb6c429 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:02.618474 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-798fe05f-b82b-4e5e-acb3-68e2cbb6c429 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:02.626078 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-798fe05f-b82b-4e5e-acb3-68e2cbb6c429 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.171861 Feb 10 03:44:02.626635 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 475/936] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:02 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:03.305656 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2e747bb0-0ca5-48e3-b391-cccae4408d9f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:03.306592 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-2e747bb0-0ca5-48e3-b391-cccae4408d9f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:03.313063 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2e747bb0-0ca5-48e3-b391-cccae4408d9f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:03.313478 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2e747bb0-0ca5-48e3-b391-cccae4408d9f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:03.314259 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2e747bb0-0ca5-48e3-b391-cccae4408d9f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:03.314723 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2e747bb0-0ca5-48e3-b391-cccae4408d9f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:03.343036 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2e747bb0-0ca5-48e3-b391-cccae4408d9f tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041349 Feb 10 03:44:03.343599 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 462/937] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Feb 10 03:44:03 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:03.401289 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-423212da-ca7c-4879-bcfd-6ea9ffd4f1ad tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:03.401865 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-423212da-ca7c-4879-bcfd-6ea9ffd4f1ad tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:03.408239 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-423212da-ca7c-4879-bcfd-6ea9ffd4f1ad tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:03.408885 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-423212da-ca7c-4879-bcfd-6ea9ffd4f1ad tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:03.409735 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-423212da-ca7c-4879-bcfd-6ea9ffd4f1ad tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:03.410486 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-423212da-ca7c-4879-bcfd-6ea9ffd4f1ad tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:03.437317 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-423212da-ca7c-4879-bcfd-6ea9ffd4f1ad tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:44:03.525893 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-423212da-ca7c-4879-bcfd-6ea9ffd4f1ad tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "DELETE /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 204 len: 0 microversion: 2.20 time: 0.128253 Feb 10 03:44:03.526701 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 476/938] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Feb 10 03:44:03 2022] DELETE /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 10 03:44:03.535438 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:03.536040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:03.542502 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:03.542906 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:03.543797 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:03.544270 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:03.643020 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-40e604e8-d0ac-4fd6-9e46-08ffe866be8a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:03.643712 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-40e604e8-d0ac-4fd6-9e46-08ffe866be8a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:03.649952 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-40e604e8-d0ac-4fd6-9e46-08ffe866be8a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:03.650740 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-40e604e8-d0ac-4fd6-9e46-08ffe866be8a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:03.651676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-40e604e8-d0ac-4fd6-9e46-08ffe866be8a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:03.652257 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-40e604e8-d0ac-4fd6-9e46-08ffe866be8a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:03.690338 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:03.698199 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:03.700021 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:03.701186 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d406fe07-cf2f-424f-9520-18fcd8135b09 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.169863 Feb 10 03:44:03.701727 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 463/939] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:44:03 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:44:03.804140 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-40e604e8-d0ac-4fd6-9e46-08ffe866be8a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:03.811527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-40e604e8-d0ac-4fd6-9e46-08ffe866be8a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.172556 Feb 10 03:44:03.812252 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 477/940] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:03 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:44:04.720230 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:04.720835 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:04.739009 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:04.739126 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:04.739928 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:04.740365 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:04.829313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1d1e290e-1ddf-4fb3-82ce-738ed64e23e8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:04.829738 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1d1e290e-1ddf-4fb3-82ce-738ed64e23e8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:04.836868 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1d1e290e-1ddf-4fb3-82ce-738ed64e23e8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:04.837389 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1d1e290e-1ddf-4fb3-82ce-738ed64e23e8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:04.838281 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1d1e290e-1ddf-4fb3-82ce-738ed64e23e8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:04.838843 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1d1e290e-1ddf-4fb3-82ce-738ed64e23e8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:04.888883 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:04.896777 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:04.898538 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:04.899728 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-017611ea-2332-4e96-aed6-570b9aed8759 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1721 microversion: 2.20 time: 0.183354 Feb 10 03:44:04.900288 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 464/941] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:44:04 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 10 03:44:04.980456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-1d1e290e-1ddf-4fb3-82ce-738ed64e23e8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:04.989927 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1d1e290e-1ddf-4fb3-82ce-738ed64e23e8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.164858 Feb 10 03:44:04.990806 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 478/942] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:04 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:44:05.542870 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-b32e05b8-c0f9-4373-b902-d67623d3a60b req-eab1f037-197a-4f33-afe5-7c5fae94ab2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc16f9d-92be-495d-abdf-9357e248264d", "name": "network-vif-plugged", "status": "completed", "tag": "f1a017bb-b64b-41fc-802b-4d4964557ece"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:05.544624 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:44:05.544624 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:44:05.552152 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-b32e05b8-c0f9-4373-b902-d67623d3a60b req-eab1f037-197a-4f33-afe5-7c5fae94ab2d service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:05.553090 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-b32e05b8-c0f9-4373-b902-d67623d3a60b req-eab1f037-197a-4f33-afe5-7c5fae94ab2d service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:05.571713 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-b32e05b8-c0f9-4373-b902-d67623d3a60b req-eab1f037-197a-4f33-afe5-7c5fae94ab2d service nova] Creating event network-vif-plugged:f1a017bb-b64b-41fc-802b-4d4964557ece for instance 1bc16f9d-92be-495d-abdf-9357e248264d on hv-cinder-82806 Feb 10 03:44:05.577937 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-b32e05b8-c0f9-4373-b902-d67623d3a60b req-eab1f037-197a-4f33-afe5-7c5fae94ab2d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039337 Feb 10 03:44:05.578829 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 465/943] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:44:05.919377 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:05.920294 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:05.927904 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:05.928354 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:05.929149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:05.929584 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:06.009034 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-dd464be1-c399-4615-a02d-358928eae767 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:06.009728 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-dd464be1-c399-4615-a02d-358928eae767 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:06.017407 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd464be1-c399-4615-a02d-358928eae767 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:06.018108 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd464be1-c399-4615-a02d-358928eae767 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:06.019544 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd464be1-c399-4615-a02d-358928eae767 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:06.021120 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-dd464be1-c399-4615-a02d-358928eae767 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:06.040727 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:06.052755 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:06.057970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd637094d14264332b6a947fe1e5c0ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e1249fa4204bf9ba3044c3c1260634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:06.060014 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-9bd232f6-775d-4321-85df-c03c54e2a52e tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 200 len: 1653 microversion: 2.20 time: 0.144646 Feb 10 03:44:06.062372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 479/944] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:44:05 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 1653 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 10 03:44:06.088563 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-80952103-8def-43d3-9991-382b14a1e9a4 req-1422e8cd-3494-4abb-815b-a3e8303283c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68175f5a-583d-43b3-a6f6-3b045303c1d1", "name": "network-vif-deleted", "tag": "dd4ed260-10d2-4b11-ae4a-2e37c7f81db6"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:06.091827 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:44:06.091827 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:44:06.101711 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-80952103-8def-43d3-9991-382b14a1e9a4 req-1422e8cd-3494-4abb-815b-a3e8303283c3 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:06.102435 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-80952103-8def-43d3-9991-382b14a1e9a4 req-1422e8cd-3494-4abb-815b-a3e8303283c3 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:06.117109 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-80952103-8def-43d3-9991-382b14a1e9a4 req-1422e8cd-3494-4abb-815b-a3e8303283c3 service nova] Creating event network-vif-deleted:dd4ed260-10d2-4b11-ae4a-2e37c7f81db6 for instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 on hv-cinder-82806 Feb 10 03:44:06.126175 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-80952103-8def-43d3-9991-382b14a1e9a4 req-1422e8cd-3494-4abb-815b-a3e8303283c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041617 Feb 10 03:44:06.126838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 480/945] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:44:06.223538 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-dd464be1-c399-4615-a02d-358928eae767 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:06.244949 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-dd464be1-c399-4615-a02d-358928eae767 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1261 microversion: 2.1 time: 0.240144 Feb 10 03:44:06.246127 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 466/946] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:06 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:07.081506 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:07.082304 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:07.089254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:07.089847 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:07.090969 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:07.091517 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:07.106055 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] HTTP exception thrown: Instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 could not be found. Feb 10 03:44:07.106378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Returning 404 to user: Instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:44:07.107238 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4bb99a8c-c214-4dc1-b48d-d71cab297ed1 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 404 len: 111 microversion: 2.20 time: 0.030781 Feb 10 03:44:07.107793 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 481/947] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:44:07 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:44:07.116557 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2544333e-7a6e-4fa4-9b18-6e5c19ebef89 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '.version_select at 0x7fe95a3395e0>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:07.135922 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2544333e-7a6e-4fa4-9b18-6e5c19ebef89 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-44903931" status: 204 len: 0 microversion: 2.20 time: 0.023160 Feb 10 03:44:07.136798 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 467/948] 10.222.0.32 () {60 vars in 1255 bytes} [Thu Feb 10 03:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-44903931 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 10 03:44:07.262125 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5bd52cca-272e-4997-8f2d-e91b23a167ae tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:07.262697 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5bd52cca-272e-4997-8f2d-e91b23a167ae tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:07.270772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5bd52cca-272e-4997-8f2d-e91b23a167ae tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:07.271178 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5bd52cca-272e-4997-8f2d-e91b23a167ae tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:07.271970 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5bd52cca-272e-4997-8f2d-e91b23a167ae tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:07.272404 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5bd52cca-272e-4997-8f2d-e91b23a167ae tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:07.556746 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5bd52cca-272e-4997-8f2d-e91b23a167ae tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:07.564766 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5bd52cca-272e-4997-8f2d-e91b23a167ae tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1446 microversion: 2.1 time: 0.306345 Feb 10 03:44:07.565315 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 482/949] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:07 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1446 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:07.580486 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7e0b4f96-4517-4419-bce5-b9386e41e9ed tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:07.581097 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7e0b4f96-4517-4419-bce5-b9386e41e9ed tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:07.587312 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e0b4f96-4517-4419-bce5-b9386e41e9ed tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:07.587972 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e0b4f96-4517-4419-bce5-b9386e41e9ed tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:07.588949 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e0b4f96-4517-4419-bce5-b9386e41e9ed tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:07.589633 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7e0b4f96-4517-4419-bce5-b9386e41e9ed tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:07.810131 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7e0b4f96-4517-4419-bce5-b9386e41e9ed tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:07.819142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7e0b4f96-4517-4419-bce5-b9386e41e9ed tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1446 microversion: 2.1 time: 0.242321 Feb 10 03:44:07.820013 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 468/950] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:07 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:09.146616 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:09.147182 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:09.153612 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:09.154053 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:09.155139 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:09.155570 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:09.169663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] HTTP exception thrown: Instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 could not be found. Feb 10 03:44:09.170246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Returning 404 to user: Instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:44:09.171094 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-73af4ab6-96fa-4ec2-b776-2658bbb6dd04 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "DELETE /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 404 len: 111 microversion: 2.20 time: 0.028404 Feb 10 03:44:09.171963 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 483/951] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Feb 10 03:44:09 2022] DELETE /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:44:09.179619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:09.180350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: 68175f5a-583d-43b3-a6f6-3b045303c1d1] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:09.187022 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:09.187476 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:09.188274 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:09.189070 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:09.202083 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] HTTP exception thrown: Instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 could not be found. Feb 10 03:44:09.202685 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Returning 404 to user: Instance 68175f5a-583d-43b3-a6f6-3b045303c1d1 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:44:09.203518 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fbfc31ae-91ec-4276-aaed-3d2df7f2f971 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1" status: 404 len: 111 microversion: 2.20 time: 0.027810 Feb 10 03:44:09.204148 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 469/952] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:44:09 2022] GET /compute/v2.1/servers/68175f5a-583d-43b3-a6f6-3b045303c1d1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:44:09.965437 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-fcb2b577-5e12-49c1-a047-73c522cf6e68 req-bd5cf779-e4fb-49cd-bfbf-a7daf35b34f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc16f9d-92be-495d-abdf-9357e248264d", "tag": "f1a017bb-b64b-41fc-802b-4d4964557ece"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:09.967326 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:44:09.967326 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:44:09.975085 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-fcb2b577-5e12-49c1-a047-73c522cf6e68 req-bd5cf779-e4fb-49cd-bfbf-a7daf35b34f8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:09.975899 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-fcb2b577-5e12-49c1-a047-73c522cf6e68 req-bd5cf779-e4fb-49cd-bfbf-a7daf35b34f8 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:09.990613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-fcb2b577-5e12-49c1-a047-73c522cf6e68 req-bd5cf779-e4fb-49cd-bfbf-a7daf35b34f8 service nova] Creating event network-changed:f1a017bb-b64b-41fc-802b-4d4964557ece for instance 1bc16f9d-92be-495d-abdf-9357e248264d on hv-cinder-82806 Feb 10 03:44:09.996703 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-fcb2b577-5e12-49c1-a047-73c522cf6e68 req-bd5cf779-e4fb-49cd-bfbf-a7daf35b34f8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036257 Feb 10 03:44:09.997670 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 484/953] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:44:10.363384 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:10.365464 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:10.373988 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:10.374540 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:10.375848 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:10.376497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:10.391207 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] HTTP exception thrown: Instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 could not be found. Feb 10 03:44:10.392220 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Returning 404 to user: Instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:44:10.393259 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-72f00c1d-3bc8-42f2-9a57-6caee78702df tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 404 len: 111 microversion: 2.20 time: 0.037347 Feb 10 03:44:10.394310 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 470/954] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Feb 10 03:44:10 2022] DELETE /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:44:10.402949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:10.404564 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] [instance: d302b3d4-6282-4fbe-a4c4-248881ee8f51] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:10.411616 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:10.412372 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:10.413403 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:10.414059 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:10.434148 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] HTTP exception thrown: Instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 could not be found. Feb 10 03:44:10.435119 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] Returning 404 to user: Instance d302b3d4-6282-4fbe-a4c4-248881ee8f51 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:44:10.436128 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3645a5e6-cb2f-4674-8ad5-d134e68ba302 tempest-AttachVolumeShelveTestJSON-869546420 tempest-AttachVolumeShelveTestJSON-869546420-project] 10.222.0.32 "GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51" status: 404 len: 111 microversion: 2.20 time: 0.037754 Feb 10 03:44:10.440484 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 485/955] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Feb 10 03:44:10 2022] GET /compute/v2.1/servers/d302b3d4-6282-4fbe-a4c4-248881ee8f51 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 10 03:44:15.198055 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-13e403f5-5197-4808-bb83-4747108cc3b3 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] Action: 'create', calling method: .version_select at 0x7fe95f062a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1898638403", "metadata": {"Type": "work"}}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:15.492870 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-13e403f5-5197-4808-bb83-4747108cc3b3 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.416814 Feb 10 03:44:15.493667 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 471/956] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Feb 10 03:44:15 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 10 03:44:15.504573 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3064dd9f-f3bb-4729-aaf1-96c29efe6aa9 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] Calling method '.version_select at 0x7fe95a1ed3a0>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:15.555488 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3064dd9f-f3bb-4729-aaf1-96c29efe6aa9 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e" status: 200 len: 353 microversion: 2.1 time: 0.054443 Feb 10 03:44:15.556020 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 486/957] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:44:15 2022] GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:44:16.573414 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c14613e4-73ac-44b9-adce-9dbdaeed9ccc tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] Calling method '.version_select at 0x7fe95a341a60>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:16.623428 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c14613e4-73ac-44b9-adce-9dbdaeed9ccc tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e" status: 200 len: 354 microversion: 2.1 time: 0.057120 Feb 10 03:44:16.623990 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 472/958] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:44:16 2022] GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:44:16.635420 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-dd6fd372-ac9a-433d-aa31-d223c236b6a9 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] Calling method '.version_select at 0x7fe95a1c9820>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:16.683502 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-dd6fd372-ac9a-433d-aa31-d223c236b6a9 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e" status: 200 len: 354 microversion: 2.1 time: 0.052118 Feb 10 03:44:16.684069 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 487/959] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:44:16 2022] GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:44:16.701108 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-829b995a-4a76-4c6f-82d4-e47054549365 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] Calling method '.version_select at 0x7fe95a370f70>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:16.765873 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-829b995a-4a76-4c6f-82d4-e47054549365 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e" status: 202 len: 0 microversion: 2.1 time: 0.068879 Feb 10 03:44:16.766607 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 473/960] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Feb 10 03:44:16 2022] DELETE /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:44:16.774561 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2ce87d4b-6f5e-4875-a399-c71e9d66628d tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] Calling method '.version_select at 0x7fe95a21d670>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:16.819497 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2ce87d4b-6f5e-4875-a399-c71e9d66628d tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e" status: 200 len: 353 microversion: 2.1 time: 0.048554 Feb 10 03:44:16.820062 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 488/961] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:44:16 2022] GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:44:17.836598 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b57455f6-e0b2-4c0a-ae26-1ff921c3c7d4 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] Calling method '.version_select at 0x7fe95a3adf70>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:17.874925 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-b57455f6-e0b2-4c0a-ae26-1ff921c3c7d4 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] HTTP exception thrown: Volume f072ccaa-ffab-4eeb-bd1d-b129171b489e could not be found. Feb 10 03:44:17.875745 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b57455f6-e0b2-4c0a-ae26-1ff921c3c7d4 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] Returning 404 to user: Volume f072ccaa-ffab-4eeb-bd1d-b129171b489e could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:44:17.876763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b57455f6-e0b2-4c0a-ae26-1ff921c3c7d4 tempest-VolumesGetTestJSON-2080795333 tempest-VolumesGetTestJSON-2080795333-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e" status: 404 len: 109 microversion: 2.1 time: 0.047291 Feb 10 03:44:17.877488 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 474/962] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Feb 10 03:44:17 2022] GET /compute/v2.1/os-volumes/f072ccaa-ffab-4eeb-bd1d-b129171b489e => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:44:45.992681 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-874607726", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1051863551", "security_groups": [{"name": "tempest-secgroup-smoke-497865012"}], "block_device_mapping_v2": [{"uuid": "7b5e6ea1-8977-46c6-86f2-eee7f8f006e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3af7982f-b432-4a57-9896-b601a1ffbd3e"}]}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:46.110940 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.network.neutron [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] validate_networks() for [('3af7982f-b432-4a57-9896-b601a1ffbd3e', None, None, None, None, None)] {{(pid=127952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:44:46.509568 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Flavor limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:44:46.509986 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Image limits 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:44:46.510530 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Flavor pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:44:46.510985 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Image pref 0:0:0 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:44:46.511446 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.virt.hardware [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:44:46.520188 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:46.520619 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:46.521423 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:46.521856 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:46.538727 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for project 9861d9e039084b9b9b24721464eea6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:44:46.542702 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.quota [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Getting quotas for user 1521bf93314c437798ef374963def38e and project 9861d9e039084b9b9b24721464eea6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=127952) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:44:46.604639 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Going to run 1 instances... {{(pid=127952) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:44:46.606854 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b5e6ea1-8977-46c6-86f2-eee7f8f006e3',volume_size=None,volume_type=None)] {{(pid=127952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:44:46.752430 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-46f0791f-ba8e-45ab-a8a5-187a0212420b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764292 Feb 10 03:44:46.753059 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 489/963] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:44:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:44:46.764378 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-acdd742a-1e76-492c-94bd-39258819564e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:46.765074 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-acdd742a-1e76-492c-94bd-39258819564e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:46.828435 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-acdd742a-1e76-492c-94bd-39258819564e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:46.835000 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-acdd742a-1e76-492c-94bd-39258819564e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1094 microversion: 2.1 time: 0.075516 Feb 10 03:44:46.843115 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 475/964] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:46 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:44:47.851523 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ba0d2c7e-53d8-4314-b5f2-fabae285d97e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:47.853000 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ba0d2c7e-53d8-4314-b5f2-fabae285d97e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:47.860079 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ba0d2c7e-53d8-4314-b5f2-fabae285d97e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:47.860524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ba0d2c7e-53d8-4314-b5f2-fabae285d97e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:47.861318 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ba0d2c7e-53d8-4314-b5f2-fabae285d97e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:47.861797 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ba0d2c7e-53d8-4314-b5f2-fabae285d97e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:47.927750 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ba0d2c7e-53d8-4314-b5f2-fabae285d97e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:47.935462 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ba0d2c7e-53d8-4314-b5f2-fabae285d97e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1210 microversion: 2.1 time: 0.087552 Feb 10 03:44:47.936108 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 490/965] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:47 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:48.953873 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-0bc87383-22b1-4489-8edf-1379a6efca18 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:48.954481 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-0bc87383-22b1-4489-8edf-1379a6efca18 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:48.962605 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0bc87383-22b1-4489-8edf-1379a6efca18 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:48.963340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0bc87383-22b1-4489-8edf-1379a6efca18 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:48.964252 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0bc87383-22b1-4489-8edf-1379a6efca18 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:48.964829 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-0bc87383-22b1-4489-8edf-1379a6efca18 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:49.123407 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-0bc87383-22b1-4489-8edf-1379a6efca18 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:49.132060 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-0bc87383-22b1-4489-8edf-1379a6efca18 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.182921 Feb 10 03:44:49.132625 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 476/966] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:48 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:49.370923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-15e3d741-b57f-483b-9ff3-f0a3048c60f3 req-980699be-da22-4a33-9311-09798a400dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a759433-8756-49d7-a4a9-eacff05a60a8", "tag": "4d591c4e-5ea2-4a7e-ad49-178e3a247434"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:49.375862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:44:49.375862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:44:49.390313 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-15e3d741-b57f-483b-9ff3-f0a3048c60f3 req-980699be-da22-4a33-9311-09798a400dec service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:49.391139 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-15e3d741-b57f-483b-9ff3-f0a3048c60f3 req-980699be-da22-4a33-9311-09798a400dec service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:49.408224 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-15e3d741-b57f-483b-9ff3-f0a3048c60f3 req-980699be-da22-4a33-9311-09798a400dec service nova] Creating event network-changed:4d591c4e-5ea2-4a7e-ad49-178e3a247434 for instance 7a759433-8756-49d7-a4a9-eacff05a60a8 on hv-cinder-82806 Feb 10 03:44:49.417982 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-15e3d741-b57f-483b-9ff3-f0a3048c60f3 req-980699be-da22-4a33-9311-09798a400dec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056377 Feb 10 03:44:49.419384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 491/967] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:44:50.149495 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-994999f7-2507-45f6-b32d-4960de44bf68 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:50.150191 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-994999f7-2507-45f6-b32d-4960de44bf68 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:50.157488 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-994999f7-2507-45f6-b32d-4960de44bf68 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:50.157916 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-994999f7-2507-45f6-b32d-4960de44bf68 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:50.158763 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-994999f7-2507-45f6-b32d-4960de44bf68 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:50.159201 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-994999f7-2507-45f6-b32d-4960de44bf68 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:50.293124 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-994999f7-2507-45f6-b32d-4960de44bf68 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:50.300904 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-994999f7-2507-45f6-b32d-4960de44bf68 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.155251 Feb 10 03:44:50.301484 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 477/968] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:50 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:51.322524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7680dda3-c66f-4edb-926d-1e5078ede9a3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:51.323322 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7680dda3-c66f-4edb-926d-1e5078ede9a3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:51.330563 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7680dda3-c66f-4edb-926d-1e5078ede9a3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:51.331094 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7680dda3-c66f-4edb-926d-1e5078ede9a3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:51.331961 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7680dda3-c66f-4edb-926d-1e5078ede9a3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:51.332445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7680dda3-c66f-4edb-926d-1e5078ede9a3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:51.635048 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7680dda3-c66f-4edb-926d-1e5078ede9a3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:51.642390 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7680dda3-c66f-4edb-926d-1e5078ede9a3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.326918 Feb 10 03:44:51.643191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 492/969] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:51 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:52.659409 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-f5d440c4-65d6-45c6-9d44-872b8accf799 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:52.660019 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-f5d440c4-65d6-45c6-9d44-872b8accf799 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:52.666532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5d440c4-65d6-45c6-9d44-872b8accf799 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:52.667047 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5d440c4-65d6-45c6-9d44-872b8accf799 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:52.667832 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5d440c4-65d6-45c6-9d44-872b8accf799 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:52.668241 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-f5d440c4-65d6-45c6-9d44-872b8accf799 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:52.803787 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-f5d440c4-65d6-45c6-9d44-872b8accf799 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:52.811395 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-f5d440c4-65d6-45c6-9d44-872b8accf799 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.155831 Feb 10 03:44:52.811973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 478/970] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:52 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:53.828923 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-8d32ded8-7765-48b6-a425-1d18206a0a08 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:53.831810 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-8d32ded8-7765-48b6-a425-1d18206a0a08 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:53.839043 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8d32ded8-7765-48b6-a425-1d18206a0a08 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:53.839485 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8d32ded8-7765-48b6-a425-1d18206a0a08 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:53.840708 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8d32ded8-7765-48b6-a425-1d18206a0a08 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:53.840708 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-8d32ded8-7765-48b6-a425-1d18206a0a08 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:53.988011 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-8d32ded8-7765-48b6-a425-1d18206a0a08 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:53.996183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-8d32ded8-7765-48b6-a425-1d18206a0a08 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.171592 Feb 10 03:44:53.996663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 493/971] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:53 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:55.002524 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1314322603", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "f2e0d3aa-9a83-43d0-abe0-bb056ed8e62a"}]}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:55.012995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-7d4dee34-1a15-4af0-ba6d-a8cabd6481e0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:55.013605 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-7d4dee34-1a15-4af0-ba6d-a8cabd6481e0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:55.020456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d4dee34-1a15-4af0-ba6d-a8cabd6481e0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:55.020880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d4dee34-1a15-4af0-ba6d-a8cabd6481e0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:55.021654 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d4dee34-1a15-4af0-ba6d-a8cabd6481e0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:55.022076 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-7d4dee34-1a15-4af0-ba6d-a8cabd6481e0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:55.059395 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] validate_networks() for [('f2e0d3aa-9a83-43d0-abe0-bb056ed8e62a', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:44:55.244288 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-7d4dee34-1a15-4af0-ba6d-a8cabd6481e0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:55.252165 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-7d4dee34-1a15-4af0-ba6d-a8cabd6481e0 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.242784 Feb 10 03:44:55.252728 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 494/972] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:55 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:44:55.503785 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:44:55.504223 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:44:55.504700 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:44:55.505247 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:44:55.505665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:44:55.515955 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:55.516405 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:55.517195 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:55.517667 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:55.534801 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Getting quotas for project 971e4963ecd649e8ba5e72ebfc30318a. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:44:55.539350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Getting quotas for user 8869eb0bfb7c44e9ba3fb095a00b9e05 and project 971e4963ecd649e8ba5e72ebfc30318a. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:44:55.551026 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:44:55.553380 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:44:55.599415 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-8eb4cd91-6ffe-40fe-abdf-899be9d42cc9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602772 Feb 10 03:44:55.600042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 479/973] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:44:55.610054 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c75d56b6-a00c-4ca0-a7ac-22ed2fc30101 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:55.610686 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c75d56b6-a00c-4ca0-a7ac-22ed2fc30101 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:55.677501 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c75d56b6-a00c-4ca0-a7ac-22ed2fc30101 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:55.688147 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c75d56b6-a00c-4ca0-a7ac-22ed2fc30101 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1219 microversion: 2.1 time: 0.081786 Feb 10 03:44:55.688877 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 495/974] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:55 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:56.270270 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fa598ce9-5dbe-43d0-bdfd-96cd6683dfcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:56.270972 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fa598ce9-5dbe-43d0-bdfd-96cd6683dfcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:56.277163 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fa598ce9-5dbe-43d0-bdfd-96cd6683dfcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:56.277608 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fa598ce9-5dbe-43d0-bdfd-96cd6683dfcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:56.278408 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fa598ce9-5dbe-43d0-bdfd-96cd6683dfcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:56.278873 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fa598ce9-5dbe-43d0-bdfd-96cd6683dfcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:56.424036 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fa598ce9-5dbe-43d0-bdfd-96cd6683dfcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:56.431513 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fa598ce9-5dbe-43d0-bdfd-96cd6683dfcc tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.165587 Feb 10 03:44:56.432076 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 480/975] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:56 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:56.704820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d7aa1d4b-0c8a-47ae-a44e-dece79ad3be0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:56.705554 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d7aa1d4b-0c8a-47ae-a44e-dece79ad3be0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:56.712237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7aa1d4b-0c8a-47ae-a44e-dece79ad3be0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:56.713027 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7aa1d4b-0c8a-47ae-a44e-dece79ad3be0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:56.713832 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7aa1d4b-0c8a-47ae-a44e-dece79ad3be0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:56.714544 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d7aa1d4b-0c8a-47ae-a44e-dece79ad3be0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:56.776354 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d7aa1d4b-0c8a-47ae-a44e-dece79ad3be0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:56.783931 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d7aa1d4b-0c8a-47ae-a44e-dece79ad3be0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1279 microversion: 2.1 time: 0.082840 Feb 10 03:44:56.784492 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 496/976] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:56 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:57.448464 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-64a14c04-707f-420b-a4b6-f9184eeae975 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:57.449053 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-64a14c04-707f-420b-a4b6-f9184eeae975 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:57.455521 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-64a14c04-707f-420b-a4b6-f9184eeae975 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:57.455977 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-64a14c04-707f-420b-a4b6-f9184eeae975 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:57.456762 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-64a14c04-707f-420b-a4b6-f9184eeae975 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:57.457200 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-64a14c04-707f-420b-a4b6-f9184eeae975 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:57.596877 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-64a14c04-707f-420b-a4b6-f9184eeae975 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:57.604914 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-64a14c04-707f-420b-a4b6-f9184eeae975 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.160284 Feb 10 03:44:57.605485 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 481/977] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:57 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:57.801349 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b0eaaa2c-6418-47cd-bd5b-2c22f3c2cbe5 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:57.801933 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b0eaaa2c-6418-47cd-bd5b-2c22f3c2cbe5 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:57.808192 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b0eaaa2c-6418-47cd-bd5b-2c22f3c2cbe5 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:57.808632 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b0eaaa2c-6418-47cd-bd5b-2c22f3c2cbe5 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:57.809403 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b0eaaa2c-6418-47cd-bd5b-2c22f3c2cbe5 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:57.809831 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b0eaaa2c-6418-47cd-bd5b-2c22f3c2cbe5 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:57.957999 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-b0eaaa2c-6418-47cd-bd5b-2c22f3c2cbe5 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:57.966545 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b0eaaa2c-6418-47cd-bd5b-2c22f3c2cbe5 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1319 microversion: 2.1 time: 0.168959 Feb 10 03:44:57.967105 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 497/978] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:57 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:58.107760 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-9c2e8bad-0a4c-410e-8f34-d3baed663a13 req-0eb13b3a-f6c0-47f3-a66f-4d35ae6c3810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42e0775-08ec-42c7-b09f-8b3896441db8", "tag": "67fcf175-f342-417c-9101-ba1c35c535a0"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:58.109652 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:44:58.109652 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:44:58.118507 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-9c2e8bad-0a4c-410e-8f34-d3baed663a13 req-0eb13b3a-f6c0-47f3-a66f-4d35ae6c3810 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:58.119196 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-9c2e8bad-0a4c-410e-8f34-d3baed663a13 req-0eb13b3a-f6c0-47f3-a66f-4d35ae6c3810 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:58.131275 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-9c2e8bad-0a4c-410e-8f34-d3baed663a13 req-0eb13b3a-f6c0-47f3-a66f-4d35ae6c3810 service nova] Creating event network-changed:67fcf175-f342-417c-9101-ba1c35c535a0 for instance f42e0775-08ec-42c7-b09f-8b3896441db8 on hv-cinder-82806 Feb 10 03:44:58.136372 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-9c2e8bad-0a4c-410e-8f34-d3baed663a13 req-0eb13b3a-f6c0-47f3-a66f-4d35ae6c3810 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032346 Feb 10 03:44:58.136942 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 482/979] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:44:58.623384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c335b066-a695-455a-bf83-7eb3aac2efd2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:58.624004 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c335b066-a695-455a-bf83-7eb3aac2efd2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:58.630325 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c335b066-a695-455a-bf83-7eb3aac2efd2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:58.630822 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c335b066-a695-455a-bf83-7eb3aac2efd2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:58.631590 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c335b066-a695-455a-bf83-7eb3aac2efd2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:58.632026 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c335b066-a695-455a-bf83-7eb3aac2efd2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:58.776301 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c335b066-a695-455a-bf83-7eb3aac2efd2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:58.784007 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c335b066-a695-455a-bf83-7eb3aac2efd2 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.164628 Feb 10 03:44:58.784576 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 498/980] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:58 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:58.988662 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bad150d6-5019-450c-acc4-d68472395759 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:58.989248 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bad150d6-5019-450c-acc4-d68472395759 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:58.996619 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bad150d6-5019-450c-acc4-d68472395759 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:58.997078 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bad150d6-5019-450c-acc4-d68472395759 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:58.998435 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bad150d6-5019-450c-acc4-d68472395759 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:58.998578 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bad150d6-5019-450c-acc4-d68472395759 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:59.135557 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bad150d6-5019-450c-acc4-d68472395759 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:59.143248 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bad150d6-5019-450c-acc4-d68472395759 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1319 microversion: 2.1 time: 0.161121 Feb 10 03:44:59.143789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 483/981] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:58 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:44:59.800872 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e36bfda8-db98-4704-b1fb-f960785d1c11 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:44:59.801464 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e36bfda8-db98-4704-b1fb-f960785d1c11 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:44:59.808254 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e36bfda8-db98-4704-b1fb-f960785d1c11 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:59.808711 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e36bfda8-db98-4704-b1fb-f960785d1c11 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:59.809492 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e36bfda8-db98-4704-b1fb-f960785d1c11 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:59.809931 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e36bfda8-db98-4704-b1fb-f960785d1c11 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:59.851888 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-c717d757-94f8-4fa4-bfbd-b7cb74e1866d req-d0540670-0132-4dcb-b2a2-e28b02bc5f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a759433-8756-49d7-a4a9-eacff05a60a8", "name": "network-vif-plugged", "status": "completed", "tag": "4d591c4e-5ea2-4a7e-ad49-178e3a247434"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:44:59.853521 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:44:59.853521 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:44:59.860452 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-c717d757-94f8-4fa4-bfbd-b7cb74e1866d req-d0540670-0132-4dcb-b2a2-e28b02bc5f16 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:44:59.860933 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-c717d757-94f8-4fa4-bfbd-b7cb74e1866d req-d0540670-0132-4dcb-b2a2-e28b02bc5f16 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:44:59.874161 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-c717d757-94f8-4fa4-bfbd-b7cb74e1866d req-d0540670-0132-4dcb-b2a2-e28b02bc5f16 service nova] Creating event network-vif-plugged:4d591c4e-5ea2-4a7e-ad49-178e3a247434 for instance 7a759433-8756-49d7-a4a9-eacff05a60a8 on hv-cinder-82806 Feb 10 03:44:59.879111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-c717d757-94f8-4fa4-bfbd-b7cb74e1866d req-d0540670-0132-4dcb-b2a2-e28b02bc5f16 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030828 Feb 10 03:44:59.879938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 484/982] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:44:59.954819 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e36bfda8-db98-4704-b1fb-f960785d1c11 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:44:59.962283 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e36bfda8-db98-4704-b1fb-f960785d1c11 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.165203 Feb 10 03:44:59.962880 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 499/983] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:44:59 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:00.160837 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bcaa00df-e114-4c80-abb3-2def7869ff4b tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:00.161519 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bcaa00df-e114-4c80-abb3-2def7869ff4b tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:00.168137 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bcaa00df-e114-4c80-abb3-2def7869ff4b tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:00.168577 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bcaa00df-e114-4c80-abb3-2def7869ff4b tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:00.169316 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bcaa00df-e114-4c80-abb3-2def7869ff4b tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:00.169949 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bcaa00df-e114-4c80-abb3-2def7869ff4b tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:00.316657 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bcaa00df-e114-4c80-abb3-2def7869ff4b tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:00.324952 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bcaa00df-e114-4c80-abb3-2def7869ff4b tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1319 microversion: 2.1 time: 0.168153 Feb 10 03:45:00.325521 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 485/984] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:00 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:00.981769 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-bdb70f72-bd9e-4669-9cc3-e52d7bfee5a8 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:00.982396 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-bdb70f72-bd9e-4669-9cc3-e52d7bfee5a8 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:00.990960 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bdb70f72-bd9e-4669-9cc3-e52d7bfee5a8 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:00.991998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bdb70f72-bd9e-4669-9cc3-e52d7bfee5a8 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:00.992998 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bdb70f72-bd9e-4669-9cc3-e52d7bfee5a8 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:00.993523 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-bdb70f72-bd9e-4669-9cc3-e52d7bfee5a8 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:01.138747 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-bdb70f72-bd9e-4669-9cc3-e52d7bfee5a8 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:01.146928 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-bdb70f72-bd9e-4669-9cc3-e52d7bfee5a8 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1265 microversion: 2.1 time: 0.169874 Feb 10 03:45:01.147496 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 500/985] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:00 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:01.341293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fbeb0478-dd9b-4288-a4b4-7eed408ee2cc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:01.341923 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fbeb0478-dd9b-4288-a4b4-7eed408ee2cc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:01.349146 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbeb0478-dd9b-4288-a4b4-7eed408ee2cc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:01.349590 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbeb0478-dd9b-4288-a4b4-7eed408ee2cc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:01.350388 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbeb0478-dd9b-4288-a4b4-7eed408ee2cc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:01.350854 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbeb0478-dd9b-4288-a4b4-7eed408ee2cc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:01.510161 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-fbeb0478-dd9b-4288-a4b4-7eed408ee2cc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:01.521178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fbeb0478-dd9b-4288-a4b4-7eed408ee2cc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1319 microversion: 2.1 time: 0.183419 Feb 10 03:45:01.521950 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 486/986] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:01 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:02.167568 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-90024eb7-b9c6-42da-90d0-5ff3e3bb639b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:02.168554 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-90024eb7-b9c6-42da-90d0-5ff3e3bb639b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:02.178716 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-90024eb7-b9c6-42da-90d0-5ff3e3bb639b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:02.179508 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-90024eb7-b9c6-42da-90d0-5ff3e3bb639b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:02.180736 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-90024eb7-b9c6-42da-90d0-5ff3e3bb639b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:02.181176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-90024eb7-b9c6-42da-90d0-5ff3e3bb639b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:02.317224 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-90024eb7-b9c6-42da-90d0-5ff3e3bb639b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:02.324939 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-90024eb7-b9c6-42da-90d0-5ff3e3bb639b tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1451 microversion: 2.1 time: 0.163642 Feb 10 03:45:02.325663 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 501/987] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:02 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:02.340862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1839f91b-8bbf-4f60-b4fc-f8e98b4e22d9 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:02.341558 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1839f91b-8bbf-4f60-b4fc-f8e98b4e22d9 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:02.348019 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1839f91b-8bbf-4f60-b4fc-f8e98b4e22d9 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:02.348464 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1839f91b-8bbf-4f60-b4fc-f8e98b4e22d9 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:02.349245 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1839f91b-8bbf-4f60-b4fc-f8e98b4e22d9 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:02.349679 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1839f91b-8bbf-4f60-b4fc-f8e98b4e22d9 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:02.498158 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1839f91b-8bbf-4f60-b4fc-f8e98b4e22d9 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:02.509355 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1839f91b-8bbf-4f60-b4fc-f8e98b4e22d9 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1451 microversion: 2.1 time: 0.172132 Feb 10 03:45:02.509920 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 487/988] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:02 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:02.539072 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-f7d068d0-7fd0-4026-bc93-c4632ca651b4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:02.539794 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-f7d068d0-7fd0-4026-bc93-c4632ca651b4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:02.546168 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7d068d0-7fd0-4026-bc93-c4632ca651b4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:02.546557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7d068d0-7fd0-4026-bc93-c4632ca651b4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:02.547355 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7d068d0-7fd0-4026-bc93-c4632ca651b4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:02.547790 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-f7d068d0-7fd0-4026-bc93-c4632ca651b4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:02.714559 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-f7d068d0-7fd0-4026-bc93-c4632ca651b4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:02.722059 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-f7d068d0-7fd0-4026-bc93-c4632ca651b4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1319 microversion: 2.1 time: 0.186751 Feb 10 03:45:02.722620 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 502/989] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:02 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:03.738399 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7bddbb30-372b-4138-abba-6bf6589b4dee tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:03.739095 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7bddbb30-372b-4138-abba-6bf6589b4dee tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:03.746735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7bddbb30-372b-4138-abba-6bf6589b4dee tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:03.747353 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7bddbb30-372b-4138-abba-6bf6589b4dee tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:03.748395 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7bddbb30-372b-4138-abba-6bf6589b4dee tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:03.748952 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7bddbb30-372b-4138-abba-6bf6589b4dee tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:03.878424 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-61aab061-0c65-450b-a926-881f2329302b req-739b35da-7194-4446-aad2-64836bb12bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42e0775-08ec-42c7-b09f-8b3896441db8", "name": "network-vif-plugged", "status": "completed", "tag": "67fcf175-f342-417c-9101-ba1c35c535a0"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:45:03.880691 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:45:03.880691 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:45:03.888349 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-61aab061-0c65-450b-a926-881f2329302b req-739b35da-7194-4446-aad2-64836bb12bd6 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:03.889419 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-61aab061-0c65-450b-a926-881f2329302b req-739b35da-7194-4446-aad2-64836bb12bd6 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:03.891520 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7bddbb30-372b-4138-abba-6bf6589b4dee tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:03.900529 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7bddbb30-372b-4138-abba-6bf6589b4dee tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1319 microversion: 2.1 time: 0.165868 Feb 10 03:45:03.902151 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 488/990] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:03 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:03.903015 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-61aab061-0c65-450b-a926-881f2329302b req-739b35da-7194-4446-aad2-64836bb12bd6 service nova] Creating event network-vif-plugged:67fcf175-f342-417c-9101-ba1c35c535a0 for instance f42e0775-08ec-42c7-b09f-8b3896441db8 on hv-cinder-82806 Feb 10 03:45:03.908472 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-61aab061-0c65-450b-a926-881f2329302b req-739b35da-7194-4446-aad2-64836bb12bd6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033589 Feb 10 03:45:03.909408 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 503/991] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:45:04.681035 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-fa0934f0-dcc9-446b-8009-e75a61336cf9 req-604de56a-93b4-4af3-ab70-2500d70bde45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a759433-8756-49d7-a4a9-eacff05a60a8", "tag": "4d591c4e-5ea2-4a7e-ad49-178e3a247434"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:45:04.682780 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:45:04.682780 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:45:04.690077 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-fa0934f0-dcc9-446b-8009-e75a61336cf9 req-604de56a-93b4-4af3-ab70-2500d70bde45 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:04.690524 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-fa0934f0-dcc9-446b-8009-e75a61336cf9 req-604de56a-93b4-4af3-ab70-2500d70bde45 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:04.701579 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-fa0934f0-dcc9-446b-8009-e75a61336cf9 req-604de56a-93b4-4af3-ab70-2500d70bde45 service nova] Creating event network-changed:4d591c4e-5ea2-4a7e-ad49-178e3a247434 for instance 7a759433-8756-49d7-a4a9-eacff05a60a8 on hv-cinder-82806 Feb 10 03:45:04.706392 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-fa0934f0-dcc9-446b-8009-e75a61336cf9 req-604de56a-93b4-4af3-ab70-2500d70bde45 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029648 Feb 10 03:45:04.707243 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 489/992] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:45:04.918388 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-17c586ba-6726-40d3-b1f9-ec13d33a67d9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:04.919311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-17c586ba-6726-40d3-b1f9-ec13d33a67d9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:04.925827 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17c586ba-6726-40d3-b1f9-ec13d33a67d9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:04.926351 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17c586ba-6726-40d3-b1f9-ec13d33a67d9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:04.927301 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17c586ba-6726-40d3-b1f9-ec13d33a67d9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:04.927809 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-17c586ba-6726-40d3-b1f9-ec13d33a67d9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:05.066492 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-17c586ba-6726-40d3-b1f9-ec13d33a67d9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:05.074685 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-17c586ba-6726-40d3-b1f9-ec13d33a67d9 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1319 microversion: 2.1 time: 0.160886 Feb 10 03:45:05.075398 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 504/993] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:04 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:06.097298 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-583b79d8-2d59-4122-a4fa-6b709db13f12 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:06.098459 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-583b79d8-2d59-4122-a4fa-6b709db13f12 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:06.109340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-583b79d8-2d59-4122-a4fa-6b709db13f12 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:06.110089 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-583b79d8-2d59-4122-a4fa-6b709db13f12 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:06.111450 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-583b79d8-2d59-4122-a4fa-6b709db13f12 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:06.112170 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-583b79d8-2d59-4122-a4fa-6b709db13f12 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:06.264910 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-583b79d8-2d59-4122-a4fa-6b709db13f12 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:06.272736 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-583b79d8-2d59-4122-a4fa-6b709db13f12 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1508 microversion: 2.1 time: 0.182892 Feb 10 03:45:06.273307 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 490/994] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:06 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:21.452065 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-0b1daceb-c87f-4ef2-8189-f066d262842f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "559325ff-1450-475c-b2d0-911a5bae8304", "device": "/dev/sdb"}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:45:21.454246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-0b1daceb-c87f-4ef2-8189-f066d262842f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:21.462813 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0b1daceb-c87f-4ef2-8189-f066d262842f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:21.463294 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0b1daceb-c87f-4ef2-8189-f066d262842f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:21.464085 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0b1daceb-c87f-4ef2-8189-f066d262842f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:21.464526 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-0b1daceb-c87f-4ef2-8189-f066d262842f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:21.726856 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-0b1daceb-c87f-4ef2-8189-f066d262842f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "POST /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280647 Feb 10 03:45:21.727454 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 505/995] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:45:21 2022] POST /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:45:26.500772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:45:26.502020 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: Thu Feb 10 03:45:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 10 03:45:44.428830 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-20558ed0-ffbd-4349-a766-44c88ebe25f4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:44.429440 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-20558ed0-ffbd-4349-a766-44c88ebe25f4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:44.436746 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-20558ed0-ffbd-4349-a766-44c88ebe25f4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:44.437279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-20558ed0-ffbd-4349-a766-44c88ebe25f4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:44.438178 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-20558ed0-ffbd-4349-a766-44c88ebe25f4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:44.438692 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-20558ed0-ffbd-4349-a766-44c88ebe25f4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:44.520331 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.objects.instance [None req-20558ed0-ffbd-4349-a766-44c88ebe25f4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lazy-loading 'services' on Instance uuid f42e0775-08ec-42c7-b09f-8b3896441db8 {{(pid=127951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:45:44.590263 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-20558ed0-ffbd-4349-a766-44c88ebe25f4 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8/os-volume_attachments/559325ff-1450-475c-b2d0-911a5bae8304" status: 202 len: 0 microversion: 2.1 time: 0.166104 Feb 10 03:45:44.590880 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 491/996] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:45:44 2022] DELETE /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8/os-volume_attachments/559325ff-1450-475c-b2d0-911a5bae8304 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:45:45.715087 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-fc5115c5-1f71-4a81-9d7d-c2a97255943e tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:45.715699 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-fc5115c5-1f71-4a81-9d7d-c2a97255943e tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:45.723268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fc5115c5-1f71-4a81-9d7d-c2a97255943e tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:45.723726 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fc5115c5-1f71-4a81-9d7d-c2a97255943e tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:45.724507 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fc5115c5-1f71-4a81-9d7d-c2a97255943e tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:45.724946 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-fc5115c5-1f71-4a81-9d7d-c2a97255943e tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:45.748845 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-fc5115c5-1f71-4a81-9d7d-c2a97255943e tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:45:45.833855 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-fc5115c5-1f71-4a81-9d7d-c2a97255943e tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 204 len: 0 microversion: 2.1 time: 0.123097 Feb 10 03:45:45.834380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 506/997] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:45:45 2022] DELETE /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:45:45.843626 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bca0061d-83b7-43aa-ac51-cb05b87b79dc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:45.844321 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bca0061d-83b7-43aa-ac51-cb05b87b79dc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:45.850700 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bca0061d-83b7-43aa-ac51-cb05b87b79dc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:45.851155 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bca0061d-83b7-43aa-ac51-cb05b87b79dc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:45.851936 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bca0061d-83b7-43aa-ac51-cb05b87b79dc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:45.852375 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bca0061d-83b7-43aa-ac51-cb05b87b79dc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:45.995132 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-bca0061d-83b7-43aa-ac51-cb05b87b79dc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:46.003017 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bca0061d-83b7-43aa-ac51-cb05b87b79dc tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1514 microversion: 2.1 time: 0.163990 Feb 10 03:45:46.003585 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 492/998] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:45 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:47.025519 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-10ea2ae9-4bc9-410c-9927-78a948c22892 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:47.026501 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-10ea2ae9-4bc9-410c-9927-78a948c22892 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:47.037230 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-10ea2ae9-4bc9-410c-9927-78a948c22892 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:47.037980 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-10ea2ae9-4bc9-410c-9927-78a948c22892 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:47.039320 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-10ea2ae9-4bc9-410c-9927-78a948c22892 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:47.040033 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-10ea2ae9-4bc9-410c-9927-78a948c22892 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:47.184383 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-10ea2ae9-4bc9-410c-9927-78a948c22892 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:47.196781 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-10ea2ae9-4bc9-410c-9927-78a948c22892 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1514 microversion: 2.1 time: 0.178016 Feb 10 03:45:47.197692 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 507/999] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:47 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:48.217009 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a4d5015e-9a1b-484e-a5a0-0a31b99cd970 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:48.217624 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a4d5015e-9a1b-484e-a5a0-0a31b99cd970 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:48.237722 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4d5015e-9a1b-484e-a5a0-0a31b99cd970 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:48.238175 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4d5015e-9a1b-484e-a5a0-0a31b99cd970 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:48.239008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4d5015e-9a1b-484e-a5a0-0a31b99cd970 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:48.239447 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a4d5015e-9a1b-484e-a5a0-0a31b99cd970 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:48.265763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-e668a9b3-489d-435b-8839-9b05336997e1 req-884c7a85-d23e-4646-818d-1ffd5f00f047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42e0775-08ec-42c7-b09f-8b3896441db8", "name": "network-vif-deleted", "tag": "67fcf175-f342-417c-9101-ba1c35c535a0"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:45:48.267820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:45:48.267820 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:45:48.275995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-e668a9b3-489d-435b-8839-9b05336997e1 req-884c7a85-d23e-4646-818d-1ffd5f00f047 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:48.276445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-e668a9b3-489d-435b-8839-9b05336997e1 req-884c7a85-d23e-4646-818d-1ffd5f00f047 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:48.288066 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-e668a9b3-489d-435b-8839-9b05336997e1 req-884c7a85-d23e-4646-818d-1ffd5f00f047 service nova] Creating event network-vif-deleted:67fcf175-f342-417c-9101-ba1c35c535a0 for instance f42e0775-08ec-42c7-b09f-8b3896441db8 on hv-cinder-82806 Feb 10 03:45:48.293929 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-e668a9b3-489d-435b-8839-9b05336997e1 req-884c7a85-d23e-4646-818d-1ffd5f00f047 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033179 Feb 10 03:45:48.294772 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 508/1000] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:45:48.309620 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-a4d5015e-9a1b-484e-a5a0-0a31b99cd970 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:48.317243 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a4d5015e-9a1b-484e-a5a0-0a31b99cd970 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 200 len: 1472 microversion: 2.1 time: 0.104034 Feb 10 03:45:48.317799 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 493/1001] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:48 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 1472 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:45:49.339995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:49.341149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: f42e0775-08ec-42c7-b09f-8b3896441db8] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:49.351843 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:49.352590 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:49.353951 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:49.354738 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:49.371818 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] HTTP exception thrown: Instance f42e0775-08ec-42c7-b09f-8b3896441db8 could not be found. Feb 10 03:45:49.372387 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Returning 404 to user: Instance f42e0775-08ec-42c7-b09f-8b3896441db8 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:45:49.373204 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-108fc26b-0bd9-486d-a295-8d2b9c31b615 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8" status: 404 len: 111 microversion: 2.1 time: 0.040836 Feb 10 03:45:49.373741 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 509/1002] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:49 2022] GET /compute/v2.1/servers/f42e0775-08ec-42c7-b09f-8b3896441db8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:45:59.243197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2006201108", "imageRef": "efc85974-1162-430f-9dfe-9c8c3cd4622c", "flavorRef": "452", "networks": [{"uuid": "f2e0d3aa-9a83-43d0-abe0-bb056ed8e62a"}]}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:45:59.293506 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.network.neutron [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] validate_networks() for [('f2e0d3aa-9a83-43d0-abe0-bb056ed8e62a', None, None, None, None, None)] {{(pid=127951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 10 03:45:59.659336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Flavor limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 10 03:45:59.659776 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Image limits 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 10 03:45:59.660236 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Flavor pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 10 03:45:59.660641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Image pref 0:0:0 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 10 03:45:59.661039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.virt.hardware [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 10 03:45:59.672365 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:59.672826 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:59.673597 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:45:59.674054 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:45:59.691038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Getting quotas for project 971e4963ecd649e8ba5e72ebfc30318a. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 10 03:45:59.695673 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.quota [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Getting quotas for user 8869eb0bfb7c44e9ba3fb095a00b9e05 and project 971e4963ecd649e8ba5e72ebfc30318a. Resources: {'instances', 'cores', 'ram'} {{(pid=127951) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 10 03:45:59.707843 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Going to run 1 instances... {{(pid=127951) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 10 03:45:59.710212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='efc85974-1162-430f-9dfe-9c8c3cd4622c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 10 03:45:59.753503 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-6da216d2-7681-4aa1-9b1a-3e82117bd00f tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514416 Feb 10 03:45:59.754151 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 494/1003] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Feb 10 03:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 10 03:45:59.764131 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-44dd8efe-7935-4f17-a5ab-b649d2922a5d tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:45:59.764687 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-44dd8efe-7935-4f17-a5ab-b649d2922a5d tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:45:59.822531 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-44dd8efe-7935-4f17-a5ab-b649d2922a5d tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:45:59.829183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-44dd8efe-7935-4f17-a5ab-b649d2922a5d tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1219 microversion: 2.1 time: 0.068780 Feb 10 03:45:59.829707 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 510/1004] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:45:59 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:46:00.847173 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e436b0e5-709e-4202-a9a0-9c2d2cb72163 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:00.847829 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e436b0e5-709e-4202-a9a0-9c2d2cb72163 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:00.854001 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e436b0e5-709e-4202-a9a0-9c2d2cb72163 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:00.854444 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e436b0e5-709e-4202-a9a0-9c2d2cb72163 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:00.855250 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e436b0e5-709e-4202-a9a0-9c2d2cb72163 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:00.855676 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e436b0e5-709e-4202-a9a0-9c2d2cb72163 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:00.918197 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e436b0e5-709e-4202-a9a0-9c2d2cb72163 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:00.926433 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e436b0e5-709e-4202-a9a0-9c2d2cb72163 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1279 microversion: 2.1 time: 0.084358 Feb 10 03:46:00.927141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 495/1005] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:00 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:01.944129 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-c6c04529-aff7-42ac-befa-369b88f07d8a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:01.944763 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-c6c04529-aff7-42ac-befa-369b88f07d8a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:01.952272 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6c04529-aff7-42ac-befa-369b88f07d8a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:01.952949 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6c04529-aff7-42ac-befa-369b88f07d8a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:01.954073 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6c04529-aff7-42ac-befa-369b88f07d8a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:01.954358 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-c6c04529-aff7-42ac-befa-369b88f07d8a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:02.086025 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-c6c04529-aff7-42ac-befa-369b88f07d8a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:02.093512 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-c6c04529-aff7-42ac-befa-369b88f07d8a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1319 microversion: 2.1 time: 0.153250 Feb 10 03:46:02.094054 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 511/1006] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:01 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:02.181395 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-3c806a1d-545d-4791-95a6-229db5b4900c req-cf943858-b5d5-4daf-91b2-06080056492d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51f629b3-c78c-4db3-9700-497b4d7cb580", "tag": "7c394e04-12d5-4b18-a6c3-ef981fa184c3"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:02.184112 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:02.184112 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:46:02.192575 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-3c806a1d-545d-4791-95a6-229db5b4900c req-cf943858-b5d5-4daf-91b2-06080056492d service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:02.193115 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-3c806a1d-545d-4791-95a6-229db5b4900c req-cf943858-b5d5-4daf-91b2-06080056492d service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:02.204350 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-3c806a1d-545d-4791-95a6-229db5b4900c req-cf943858-b5d5-4daf-91b2-06080056492d service nova] Creating event network-changed:7c394e04-12d5-4b18-a6c3-ef981fa184c3 for instance 51f629b3-c78c-4db3-9700-497b4d7cb580 on hv-cinder-82806 Feb 10 03:46:02.209415 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-3c806a1d-545d-4791-95a6-229db5b4900c req-cf943858-b5d5-4daf-91b2-06080056492d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038359 Feb 10 03:46:02.210005 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 496/1007] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:46:03.111088 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6f53ad96-f36e-4861-b282-d6b36b4cfdbd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:03.111690 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6f53ad96-f36e-4861-b282-d6b36b4cfdbd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:03.119909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f53ad96-f36e-4861-b282-d6b36b4cfdbd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:03.120378 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f53ad96-f36e-4861-b282-d6b36b4cfdbd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:03.121176 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f53ad96-f36e-4861-b282-d6b36b4cfdbd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:03.121613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6f53ad96-f36e-4861-b282-d6b36b4cfdbd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:03.259711 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-6f53ad96-f36e-4861-b282-d6b36b4cfdbd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:03.267451 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6f53ad96-f36e-4861-b282-d6b36b4cfdbd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1319 microversion: 2.1 time: 0.160333 Feb 10 03:46:03.268006 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 512/1008] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:03 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:04.290088 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-18c54d8f-dbfa-4010-96a8-43c0a18307da tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:04.291355 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-18c54d8f-dbfa-4010-96a8-43c0a18307da tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:04.301917 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18c54d8f-dbfa-4010-96a8-43c0a18307da tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:04.302726 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18c54d8f-dbfa-4010-96a8-43c0a18307da tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:04.304004 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18c54d8f-dbfa-4010-96a8-43c0a18307da tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:04.304734 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-18c54d8f-dbfa-4010-96a8-43c0a18307da tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:04.443033 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-18c54d8f-dbfa-4010-96a8-43c0a18307da tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:04.451162 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-18c54d8f-dbfa-4010-96a8-43c0a18307da tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1319 microversion: 2.1 time: 0.168786 Feb 10 03:46:04.452101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 497/1009] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:04 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:05.473705 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a5369cfb-36b4-41d3-afa6-04e2b1588d49 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:05.474310 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a5369cfb-36b4-41d3-afa6-04e2b1588d49 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:05.481304 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a5369cfb-36b4-41d3-afa6-04e2b1588d49 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:05.481761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a5369cfb-36b4-41d3-afa6-04e2b1588d49 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:05.482557 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a5369cfb-36b4-41d3-afa6-04e2b1588d49 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:05.483126 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a5369cfb-36b4-41d3-afa6-04e2b1588d49 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:05.626760 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a5369cfb-36b4-41d3-afa6-04e2b1588d49 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:05.639083 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a5369cfb-36b4-41d3-afa6-04e2b1588d49 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1319 microversion: 2.1 time: 0.168940 Feb 10 03:46:05.639855 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 513/1010] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:05 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:06.660232 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d0d53325-9bbb-4040-b2e5-040a3eed07f3 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:06.660840 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d0d53325-9bbb-4040-b2e5-040a3eed07f3 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:06.667641 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0d53325-9bbb-4040-b2e5-040a3eed07f3 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:06.668098 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0d53325-9bbb-4040-b2e5-040a3eed07f3 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:06.673313 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0d53325-9bbb-4040-b2e5-040a3eed07f3 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:06.673498 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0d53325-9bbb-4040-b2e5-040a3eed07f3 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:06.810636 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d0d53325-9bbb-4040-b2e5-040a3eed07f3 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:06.818295 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d0d53325-9bbb-4040-b2e5-040a3eed07f3 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1319 microversion: 2.1 time: 0.161808 Feb 10 03:46:06.819013 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 498/1011] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:06 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:07.838938 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3e3a714c-5769-4818-afb9-d8b150314e30 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:07.839646 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3e3a714c-5769-4818-afb9-d8b150314e30 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:07.847079 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3e3a714c-5769-4818-afb9-d8b150314e30 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:07.847585 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3e3a714c-5769-4818-afb9-d8b150314e30 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:07.848456 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3e3a714c-5769-4818-afb9-d8b150314e30 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:07.848942 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3e3a714c-5769-4818-afb9-d8b150314e30 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:07.994709 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-3e3a714c-5769-4818-afb9-d8b150314e30 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:08.002517 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3e3a714c-5769-4818-afb9-d8b150314e30 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1319 microversion: 2.1 time: 0.169384 Feb 10 03:46:08.003324 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 514/1012] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:07 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:08.803357 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-b57973df-fefe-4903-97ef-5216d477fc4e req-121b0b1f-f6f0-4bc5-9c2b-7b931d0fb923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f629b3-c78c-4db3-9700-497b4d7cb580", "name": "network-vif-plugged", "status": "completed", "tag": "7c394e04-12d5-4b18-a6c3-ef981fa184c3"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:08.804855 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:08.804855 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:46:08.812428 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-b57973df-fefe-4903-97ef-5216d477fc4e req-121b0b1f-f6f0-4bc5-9c2b-7b931d0fb923 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:08.812876 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-b57973df-fefe-4903-97ef-5216d477fc4e req-121b0b1f-f6f0-4bc5-9c2b-7b931d0fb923 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:08.824638 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-b57973df-fefe-4903-97ef-5216d477fc4e req-121b0b1f-f6f0-4bc5-9c2b-7b931d0fb923 service nova] Creating event network-vif-plugged:7c394e04-12d5-4b18-a6c3-ef981fa184c3 for instance 51f629b3-c78c-4db3-9700-497b4d7cb580 on hv-cinder-82806 Feb 10 03:46:08.829813 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-b57973df-fefe-4903-97ef-5216d477fc4e req-121b0b1f-f6f0-4bc5-9c2b-7b931d0fb923 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030120 Feb 10 03:46:08.830413 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 499/1013] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:46:09.020002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-eb1ec43b-9cdb-4654-acc0-b646527e777a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:09.020610 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-eb1ec43b-9cdb-4654-acc0-b646527e777a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:09.036127 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eb1ec43b-9cdb-4654-acc0-b646527e777a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:09.036613 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eb1ec43b-9cdb-4654-acc0-b646527e777a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:09.037410 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eb1ec43b-9cdb-4654-acc0-b646527e777a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:09.037876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eb1ec43b-9cdb-4654-acc0-b646527e777a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:09.173555 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-eb1ec43b-9cdb-4654-acc0-b646527e777a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:09.181816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-eb1ec43b-9cdb-4654-acc0-b646527e777a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1319 microversion: 2.1 time: 0.165679 Feb 10 03:46:09.182353 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 515/1014] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:09 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:10.199700 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e83a54e6-a5b6-4a91-98d1-e4e836a427e1 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:10.200352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e83a54e6-a5b6-4a91-98d1-e4e836a427e1 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:10.207264 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e83a54e6-a5b6-4a91-98d1-e4e836a427e1 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:10.207716 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e83a54e6-a5b6-4a91-98d1-e4e836a427e1 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:10.208499 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e83a54e6-a5b6-4a91-98d1-e4e836a427e1 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:10.208933 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e83a54e6-a5b6-4a91-98d1-e4e836a427e1 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:10.344647 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e83a54e6-a5b6-4a91-98d1-e4e836a427e1 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:10.352186 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e83a54e6-a5b6-4a91-98d1-e4e836a427e1 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1319 microversion: 2.1 time: 0.156802 Feb 10 03:46:10.352738 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 500/1015] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:10 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:11.371668 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a14384cc-4e9b-476f-b32c-1c01e4ef30c0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:11.372304 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a14384cc-4e9b-476f-b32c-1c01e4ef30c0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:11.379377 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a14384cc-4e9b-476f-b32c-1c01e4ef30c0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:11.379824 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a14384cc-4e9b-476f-b32c-1c01e4ef30c0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:11.380604 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a14384cc-4e9b-476f-b32c-1c01e4ef30c0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:11.381045 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a14384cc-4e9b-476f-b32c-1c01e4ef30c0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:11.535035 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a14384cc-4e9b-476f-b32c-1c01e4ef30c0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:11.543071 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a14384cc-4e9b-476f-b32c-1c01e4ef30c0 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1508 microversion: 2.1 time: 0.175820 Feb 10 03:46:11.543637 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 516/1016] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:11 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:11.559520 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-666bd234-1899-4f5f-85df-fcc2d57dedc6 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60279664-325d-4b8f-a101-f6ab438e18f6", "device": "/dev/sdb"}} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:11.561087 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-666bd234-1899-4f5f-85df-fcc2d57dedc6 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:11.568042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-666bd234-1899-4f5f-85df-fcc2d57dedc6 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:11.568501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-666bd234-1899-4f5f-85df-fcc2d57dedc6 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:11.569289 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-666bd234-1899-4f5f-85df-fcc2d57dedc6 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:11.569727 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-666bd234-1899-4f5f-85df-fcc2d57dedc6 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:11.829255 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-666bd234-1899-4f5f-85df-fcc2d57dedc6 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "POST /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273460 Feb 10 03:46:11.829869 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 501/1017] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Feb 10 03:46:11 2022] POST /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:46:17.954184 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-eaca8827-946d-4ba8-b678-6e1a9de5328c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:17.955197 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-eaca8827-946d-4ba8-b678-6e1a9de5328c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:17.965881 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eaca8827-946d-4ba8-b678-6e1a9de5328c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:17.966446 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eaca8827-946d-4ba8-b678-6e1a9de5328c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:17.967393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eaca8827-946d-4ba8-b678-6e1a9de5328c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:17.967951 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-eaca8827-946d-4ba8-b678-6e1a9de5328c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:18.003583 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-eaca8827-946d-4ba8-b678-6e1a9de5328c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lazy-loading 'flavor' on Instance uuid 1bc16f9d-92be-495d-abdf-9357e248264d {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:46:18.080851 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-eaca8827-946d-4ba8-b678-6e1a9de5328c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "POST /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d/action" status: 202 len: 0 microversion: 2.1 time: 0.134264 Feb 10 03:46:18.081798 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 517/1018] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:46:17 2022] POST /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:46:18.091006 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-5ee8584e-b9d3-45c4-9758-9de10b1dbaf8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:18.091713 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-5ee8584e-b9d3-45c4-9758-9de10b1dbaf8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:18.098983 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5ee8584e-b9d3-45c4-9758-9de10b1dbaf8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:18.099473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5ee8584e-b9d3-45c4-9758-9de10b1dbaf8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:18.100324 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5ee8584e-b9d3-45c4-9758-9de10b1dbaf8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:18.100804 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-5ee8584e-b9d3-45c4-9758-9de10b1dbaf8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:18.251442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-5ee8584e-b9d3-45c4-9758-9de10b1dbaf8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:18.259003 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-5ee8584e-b9d3-45c4-9758-9de10b1dbaf8 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.172846 Feb 10 03:46:18.259572 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 502/1019] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:18 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:19.276168 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-023f332a-8856-47ec-88f3-e6b53b0a63ff tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:19.276614 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-023f332a-8856-47ec-88f3-e6b53b0a63ff tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:19.283676 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-023f332a-8856-47ec-88f3-e6b53b0a63ff tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:19.284035 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-023f332a-8856-47ec-88f3-e6b53b0a63ff tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:19.284807 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-023f332a-8856-47ec-88f3-e6b53b0a63ff tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:19.285262 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-023f332a-8856-47ec-88f3-e6b53b0a63ff tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:19.424988 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-023f332a-8856-47ec-88f3-e6b53b0a63ff tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:19.432787 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-023f332a-8856-47ec-88f3-e6b53b0a63ff tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.160769 Feb 10 03:46:19.433968 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 518/1020] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:19 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:20.453850 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c4739af5-2293-48f7-bb05-28efe4fea0db tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:20.454804 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c4739af5-2293-48f7-bb05-28efe4fea0db tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:20.465794 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c4739af5-2293-48f7-bb05-28efe4fea0db tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:20.466547 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c4739af5-2293-48f7-bb05-28efe4fea0db tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:20.467888 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c4739af5-2293-48f7-bb05-28efe4fea0db tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:20.468616 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c4739af5-2293-48f7-bb05-28efe4fea0db tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:20.621685 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c4739af5-2293-48f7-bb05-28efe4fea0db tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:20.632922 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c4739af5-2293-48f7-bb05-28efe4fea0db tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.185675 Feb 10 03:46:20.633682 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 503/1021] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:20 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:21.653384 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4ee60a23-0b0d-4049-b0f0-f92cd5dbae1d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:21.653990 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4ee60a23-0b0d-4049-b0f0-f92cd5dbae1d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:21.660794 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ee60a23-0b0d-4049-b0f0-f92cd5dbae1d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:21.661246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ee60a23-0b0d-4049-b0f0-f92cd5dbae1d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:21.662031 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ee60a23-0b0d-4049-b0f0-f92cd5dbae1d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:21.662463 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4ee60a23-0b0d-4049-b0f0-f92cd5dbae1d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:21.808124 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4ee60a23-0b0d-4049-b0f0-f92cd5dbae1d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:21.815950 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4ee60a23-0b0d-4049-b0f0-f92cd5dbae1d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.168009 Feb 10 03:46:21.816552 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 519/1022] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:21 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:22.832862 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-093e86c8-e9f5-42fb-8443-7a13572e635e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:22.833465 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-093e86c8-e9f5-42fb-8443-7a13572e635e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:22.840206 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-093e86c8-e9f5-42fb-8443-7a13572e635e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:22.840660 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-093e86c8-e9f5-42fb-8443-7a13572e635e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:22.841442 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-093e86c8-e9f5-42fb-8443-7a13572e635e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:22.841981 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-093e86c8-e9f5-42fb-8443-7a13572e635e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:22.985189 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-093e86c8-e9f5-42fb-8443-7a13572e635e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:22.993939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-093e86c8-e9f5-42fb-8443-7a13572e635e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.164893 Feb 10 03:46:22.994518 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 504/1023] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:22 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:24.014425 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2f14c3d5-4fec-4efb-b3f7-8fa70d5cea4b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:24.015376 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2f14c3d5-4fec-4efb-b3f7-8fa70d5cea4b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:24.025915 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f14c3d5-4fec-4efb-b3f7-8fa70d5cea4b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:24.026777 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f14c3d5-4fec-4efb-b3f7-8fa70d5cea4b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:24.027598 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f14c3d5-4fec-4efb-b3f7-8fa70d5cea4b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:24.028030 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f14c3d5-4fec-4efb-b3f7-8fa70d5cea4b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:24.168899 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2f14c3d5-4fec-4efb-b3f7-8fa70d5cea4b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:24.176800 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2f14c3d5-4fec-4efb-b3f7-8fa70d5cea4b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.168796 Feb 10 03:46:24.177368 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 520/1024] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:24 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:25.198378 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c1e83e74-70c8-45da-9bcf-5e086ff92e00 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:25.199320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c1e83e74-70c8-45da-9bcf-5e086ff92e00 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:25.207671 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c1e83e74-70c8-45da-9bcf-5e086ff92e00 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:25.208158 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c1e83e74-70c8-45da-9bcf-5e086ff92e00 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:25.209144 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c1e83e74-70c8-45da-9bcf-5e086ff92e00 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:25.209691 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c1e83e74-70c8-45da-9bcf-5e086ff92e00 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:25.355173 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c1e83e74-70c8-45da-9bcf-5e086ff92e00 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:25.366559 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c1e83e74-70c8-45da-9bcf-5e086ff92e00 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.174202 Feb 10 03:46:25.367383 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 505/1025] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:25 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:26.387806 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a1bd88a4-bcd2-49df-9fa7-f093d877f478 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:26.388424 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a1bd88a4-bcd2-49df-9fa7-f093d877f478 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:26.395185 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1bd88a4-bcd2-49df-9fa7-f093d877f478 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:26.395642 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1bd88a4-bcd2-49df-9fa7-f093d877f478 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:26.396423 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1bd88a4-bcd2-49df-9fa7-f093d877f478 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:26.396854 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1bd88a4-bcd2-49df-9fa7-f093d877f478 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:26.541157 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a1bd88a4-bcd2-49df-9fa7-f093d877f478 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:26.549077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a1bd88a4-bcd2-49df-9fa7-f093d877f478 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.166683 Feb 10 03:46:26.549668 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 521/1026] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:26 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:27.569836 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-c1da26b9-dab3-494b-a532-8a8aa1a20fb3 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:27.570821 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-c1da26b9-dab3-494b-a532-8a8aa1a20fb3 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:27.581362 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c1da26b9-dab3-494b-a532-8a8aa1a20fb3 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:27.582094 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c1da26b9-dab3-494b-a532-8a8aa1a20fb3 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:27.583501 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c1da26b9-dab3-494b-a532-8a8aa1a20fb3 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:27.584216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-c1da26b9-dab3-494b-a532-8a8aa1a20fb3 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:27.726420 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-c1da26b9-dab3-494b-a532-8a8aa1a20fb3 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:27.737697 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-c1da26b9-dab3-494b-a532-8a8aa1a20fb3 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.173759 Feb 10 03:46:27.738588 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 506/1027] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:27 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:28.757634 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a413f2d1-830a-4ca5-a98b-05cc73cf6c0e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:28.758216 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a413f2d1-830a-4ca5-a98b-05cc73cf6c0e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:28.764562 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a413f2d1-830a-4ca5-a98b-05cc73cf6c0e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:28.765011 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a413f2d1-830a-4ca5-a98b-05cc73cf6c0e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:28.765816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a413f2d1-830a-4ca5-a98b-05cc73cf6c0e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:28.766243 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a413f2d1-830a-4ca5-a98b-05cc73cf6c0e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:28.912790 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a413f2d1-830a-4ca5-a98b-05cc73cf6c0e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:28.921057 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a413f2d1-830a-4ca5-a98b-05cc73cf6c0e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.168124 Feb 10 03:46:28.921628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 522/1028] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:28 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:29.938187 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-4fd684fc-25ef-48bb-b047-a0497498076b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:29.938926 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-4fd684fc-25ef-48bb-b047-a0497498076b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:29.946847 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4fd684fc-25ef-48bb-b047-a0497498076b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:29.947300 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4fd684fc-25ef-48bb-b047-a0497498076b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:29.948081 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4fd684fc-25ef-48bb-b047-a0497498076b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:29.948515 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-4fd684fc-25ef-48bb-b047-a0497498076b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:30.083790 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-4fd684fc-25ef-48bb-b047-a0497498076b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:30.091994 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-4fd684fc-25ef-48bb-b047-a0497498076b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.158105 Feb 10 03:46:30.092583 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 507/1029] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:29 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:46:30.204481 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-1660ae12-d776-4a40-a419-bb31b6e44dcd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:30.204989 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-1660ae12-d776-4a40-a419-bb31b6e44dcd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:30.211627 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1660ae12-d776-4a40-a419-bb31b6e44dcd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:30.212076 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1660ae12-d776-4a40-a419-bb31b6e44dcd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:30.212862 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1660ae12-d776-4a40-a419-bb31b6e44dcd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:30.213326 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-1660ae12-d776-4a40-a419-bb31b6e44dcd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:30.301118 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-1660ae12-d776-4a40-a419-bb31b6e44dcd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lazy-loading 'services' on Instance uuid 51f629b3-c78c-4db3-9700-497b4d7cb580 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:46:30.376689 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-1660ae12-d776-4a40-a419-bb31b6e44dcd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "DELETE /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580/os-volume_attachments/60279664-325d-4b8f-a101-f6ab438e18f6" status: 202 len: 0 microversion: 2.1 time: 0.175887 Feb 10 03:46:30.377268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 523/1030] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Feb 10 03:46:30 2022] DELETE /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580/os-volume_attachments/60279664-325d-4b8f-a101-f6ab438e18f6 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:46:31.109216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-02bd3300-2884-47a4-8752-593c0c91f28a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:31.109934 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-02bd3300-2884-47a4-8752-593c0c91f28a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:31.117034 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-02bd3300-2884-47a4-8752-593c0c91f28a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:31.117750 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-02bd3300-2884-47a4-8752-593c0c91f28a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:31.118878 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-02bd3300-2884-47a4-8752-593c0c91f28a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:31.119317 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-02bd3300-2884-47a4-8752-593c0c91f28a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:31.271050 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-02bd3300-2884-47a4-8752-593c0c91f28a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:31.278676 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-02bd3300-2884-47a4-8752-593c0c91f28a tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.173249 Feb 10 03:46:31.279239 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 508/1031] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:31 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:31.488655 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e8a55571-7d6f-4f6c-9d9c-6c1f53dc4dfd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:31.489237 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e8a55571-7d6f-4f6c-9d9c-6c1f53dc4dfd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:31.495843 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e8a55571-7d6f-4f6c-9d9c-6c1f53dc4dfd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:31.496319 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e8a55571-7d6f-4f6c-9d9c-6c1f53dc4dfd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:31.497105 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e8a55571-7d6f-4f6c-9d9c-6c1f53dc4dfd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:31.497543 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e8a55571-7d6f-4f6c-9d9c-6c1f53dc4dfd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:31.522414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e8a55571-7d6f-4f6c-9d9c-6c1f53dc4dfd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:46:31.601243 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e8a55571-7d6f-4f6c-9d9c-6c1f53dc4dfd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "DELETE /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 204 len: 0 microversion: 2.1 time: 0.116725 Feb 10 03:46:31.601773 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 524/1032] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:46:31 2022] DELETE /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 10 03:46:31.611366 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d685526e-2bfd-4b99-8cdb-0af613322b7a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:31.611975 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d685526e-2bfd-4b99-8cdb-0af613322b7a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:31.618479 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d685526e-2bfd-4b99-8cdb-0af613322b7a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:31.618955 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d685526e-2bfd-4b99-8cdb-0af613322b7a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:31.619741 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d685526e-2bfd-4b99-8cdb-0af613322b7a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:31.620173 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d685526e-2bfd-4b99-8cdb-0af613322b7a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:31.760585 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d685526e-2bfd-4b99-8cdb-0af613322b7a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:31.768915 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d685526e-2bfd-4b99-8cdb-0af613322b7a tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1514 microversion: 2.1 time: 0.162314 Feb 10 03:46:31.769483 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 509/1033] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:31 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:32.301666 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-883c3805-974e-410e-88af-abd972cacb2c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:32.302876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-883c3805-974e-410e-88af-abd972cacb2c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:32.312310 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-883c3805-974e-410e-88af-abd972cacb2c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:32.312759 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-883c3805-974e-410e-88af-abd972cacb2c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:32.313542 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-883c3805-974e-410e-88af-abd972cacb2c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:32.313978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-883c3805-974e-410e-88af-abd972cacb2c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:32.452536 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-883c3805-974e-410e-88af-abd972cacb2c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:32.460503 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-883c3805-974e-410e-88af-abd972cacb2c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.166965 Feb 10 03:46:32.461009 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 525/1034] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:32 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:32.789950 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-1b27f86c-ee60-4014-a0bc-e1de9d0623bd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:32.790859 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-1b27f86c-ee60-4014-a0bc-e1de9d0623bd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:32.799232 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1b27f86c-ee60-4014-a0bc-e1de9d0623bd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:32.799676 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1b27f86c-ee60-4014-a0bc-e1de9d0623bd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:32.800443 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1b27f86c-ee60-4014-a0bc-e1de9d0623bd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:32.800869 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-1b27f86c-ee60-4014-a0bc-e1de9d0623bd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:32.940171 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-1b27f86c-ee60-4014-a0bc-e1de9d0623bd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:32.947938 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-1b27f86c-ee60-4014-a0bc-e1de9d0623bd tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1514 microversion: 2.1 time: 0.164207 Feb 10 03:46:32.948502 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 510/1035] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:32 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:33.477406 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-533d143f-3568-4750-9d30-9fcaf5c1190e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:33.477987 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-533d143f-3568-4750-9d30-9fcaf5c1190e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:33.484507 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-533d143f-3568-4750-9d30-9fcaf5c1190e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:33.484954 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-533d143f-3568-4750-9d30-9fcaf5c1190e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:33.485750 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-533d143f-3568-4750-9d30-9fcaf5c1190e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:33.486184 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-533d143f-3568-4750-9d30-9fcaf5c1190e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:33.622304 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-533d143f-3568-4750-9d30-9fcaf5c1190e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:33.629815 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-533d143f-3568-4750-9d30-9fcaf5c1190e tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.156171 Feb 10 03:46:33.630373 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 526/1036] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:33 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:33.965349 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e1e4fa29-624c-450c-a2c5-9cff03c7bf4c tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:33.966030 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e1e4fa29-624c-450c-a2c5-9cff03c7bf4c tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:33.973008 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa29-624c-450c-a2c5-9cff03c7bf4c tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:33.973461 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa29-624c-450c-a2c5-9cff03c7bf4c tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:33.974248 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa29-624c-450c-a2c5-9cff03c7bf4c tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:33.974690 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa29-624c-450c-a2c5-9cff03c7bf4c tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:34.112024 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e1e4fa29-624c-450c-a2c5-9cff03c7bf4c tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:34.119789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e1e4fa29-624c-450c-a2c5-9cff03c7bf4c tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1514 microversion: 2.1 time: 0.158302 Feb 10 03:46:34.120347 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 511/1037] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:33 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:34.609444 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-ca04dd18-0827-4777-88ef-cdcdf727f426 req-1bf8c92d-a9e6-4858-8fcf-f713957ca4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51f629b3-c78c-4db3-9700-497b4d7cb580", "name": "network-vif-deleted", "tag": "7c394e04-12d5-4b18-a6c3-ef981fa184c3"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:34.611099 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:34.611099 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:46:34.620441 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-ca04dd18-0827-4777-88ef-cdcdf727f426 req-1bf8c92d-a9e6-4858-8fcf-f713957ca4fb service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:34.620956 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-ca04dd18-0827-4777-88ef-cdcdf727f426 req-1bf8c92d-a9e6-4858-8fcf-f713957ca4fb service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:34.633393 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-ca04dd18-0827-4777-88ef-cdcdf727f426 req-1bf8c92d-a9e6-4858-8fcf-f713957ca4fb service nova] Creating event network-vif-deleted:7c394e04-12d5-4b18-a6c3-ef981fa184c3 for instance 51f629b3-c78c-4db3-9700-497b4d7cb580 on hv-cinder-82806 Feb 10 03:46:34.638896 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-ca04dd18-0827-4777-88ef-cdcdf727f426 req-1bf8c92d-a9e6-4858-8fcf-f713957ca4fb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033042 Feb 10 03:46:34.639494 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 527/1038] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:46:34.648576 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d14ba4c6-bbd9-4023-96f8-dda5c6ff46a5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:34.649175 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d14ba4c6-bbd9-4023-96f8-dda5c6ff46a5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:34.655152 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d14ba4c6-bbd9-4023-96f8-dda5c6ff46a5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:34.655593 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d14ba4c6-bbd9-4023-96f8-dda5c6ff46a5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:34.656363 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d14ba4c6-bbd9-4023-96f8-dda5c6ff46a5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:34.656815 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d14ba4c6-bbd9-4023-96f8-dda5c6ff46a5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:34.801320 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d14ba4c6-bbd9-4023-96f8-dda5c6ff46a5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:34.808806 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d14ba4c6-bbd9-4023-96f8-dda5c6ff46a5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.164370 Feb 10 03:46:34.809370 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 512/1039] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:34 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:35.137379 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:35.138075 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:35.144844 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:35.145340 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:35.146364 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:35.148461 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:35.181586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:35.182027 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:35.182479 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.objects.instance [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lazy-loading 'fault' on Instance uuid 51f629b3-c78c-4db3-9700-497b4d7cb580 {{(pid=127952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 10 03:46:35.222445 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8869eb0bfb7c44e9ba3fb095a00b9e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e4963ecd649e8ba5e72ebfc30318a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:35.229461 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-9b3b9f73-0d1b-4006-8d41-e29d46b812ab tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 200 len: 1309 microversion: 2.1 time: 0.096266 Feb 10 03:46:35.230014 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 528/1040] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:35 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:35.829617 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-3b87799e-f5ae-488e-9a92-01f5bdf8e039 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:35.831314 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-3b87799e-f5ae-488e-9a92-01f5bdf8e039 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:35.845208 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3b87799e-f5ae-488e-9a92-01f5bdf8e039 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:35.845958 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3b87799e-f5ae-488e-9a92-01f5bdf8e039 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:35.847281 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3b87799e-f5ae-488e-9a92-01f5bdf8e039 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:35.847998 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-3b87799e-f5ae-488e-9a92-01f5bdf8e039 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:35.990570 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-3b87799e-f5ae-488e-9a92-01f5bdf8e039 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:35.998238 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-3b87799e-f5ae-488e-9a92-01f5bdf8e039 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.175208 Feb 10 03:46:35.998838 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 513/1041] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:35 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:36.247654 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:36.248414 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] [instance: 51f629b3-c78c-4db3-9700-497b4d7cb580] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:36.255688 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:36.256179 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:36.257078 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:36.257625 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:36.271348 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] HTTP exception thrown: Instance 51f629b3-c78c-4db3-9700-497b4d7cb580 could not be found. Feb 10 03:46:36.272629 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] Returning 404 to user: Instance 51f629b3-c78c-4db3-9700-497b4d7cb580 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:46:36.273480 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-6e84ab3d-3acc-4aa6-b2bf-4b0d9d41d3d7 tempest-VolumesSnapshotTestJSON-1197572729 tempest-VolumesSnapshotTestJSON-1197572729-project] 10.222.0.32 "GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580" status: 404 len: 111 microversion: 2.1 time: 0.030147 Feb 10 03:46:36.274042 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 529/1042] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:36 2022] GET /compute/v2.1/servers/51f629b3-c78c-4db3-9700-497b4d7cb580 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:46:37.015833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-55186dfb-0976-41fd-a213-ce02a872b4ef tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:37.016459 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-55186dfb-0976-41fd-a213-ce02a872b4ef tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:37.023332 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-55186dfb-0976-41fd-a213-ce02a872b4ef tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:37.023964 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-55186dfb-0976-41fd-a213-ce02a872b4ef tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:37.024746 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-55186dfb-0976-41fd-a213-ce02a872b4ef tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:37.025179 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-55186dfb-0976-41fd-a213-ce02a872b4ef tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:37.186216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-55186dfb-0976-41fd-a213-ce02a872b4ef tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:37.196543 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-55186dfb-0976-41fd-a213-ce02a872b4ef tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1512 microversion: 2.1 time: 0.184468 Feb 10 03:46:37.197209 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 514/1043] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:37 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:37.215761 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e7df8a03-4267-4bc5-ba4a-8bf4e15e1274 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:37.216335 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e7df8a03-4267-4bc5-ba4a-8bf4e15e1274 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:37.222517 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7df8a03-4267-4bc5-ba4a-8bf4e15e1274 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:37.223012 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7df8a03-4267-4bc5-ba4a-8bf4e15e1274 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:37.223835 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7df8a03-4267-4bc5-ba4a-8bf4e15e1274 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:37.224290 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e7df8a03-4267-4bc5-ba4a-8bf4e15e1274 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:37.303127 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e7df8a03-4267-4bc5-ba4a-8bf4e15e1274 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "POST /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d/action" status: 202 len: 0 microversion: 2.1 time: 0.091191 Feb 10 03:46:37.303959 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 530/1044] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Feb 10 03:46:37 2022] POST /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:46:37.312256 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-60e73a78-5270-4e80-a50c-0c24b950b15d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:37.312843 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-60e73a78-5270-4e80-a50c-0c24b950b15d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:37.318809 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-60e73a78-5270-4e80-a50c-0c24b950b15d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:37.319263 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-60e73a78-5270-4e80-a50c-0c24b950b15d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:37.320042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-60e73a78-5270-4e80-a50c-0c24b950b15d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:37.320479 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-60e73a78-5270-4e80-a50c-0c24b950b15d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:37.636168 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-60e73a78-5270-4e80-a50c-0c24b950b15d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:37.643665 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-60e73a78-5270-4e80-a50c-0c24b950b15d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1520 microversion: 2.1 time: 0.335529 Feb 10 03:46:37.644579 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 515/1045] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:37 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:38.665294 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-4bd5d1ce-0394-4137-97df-7f43014c8013 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:38.666260 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-4bd5d1ce-0394-4137-97df-7f43014c8013 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:38.675698 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bd5d1ce-0394-4137-97df-7f43014c8013 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:38.676142 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bd5d1ce-0394-4137-97df-7f43014c8013 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:38.677026 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bd5d1ce-0394-4137-97df-7f43014c8013 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:38.677352 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-4bd5d1ce-0394-4137-97df-7f43014c8013 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:38.812838 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-4bd5d1ce-0394-4137-97df-7f43014c8013 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:38.820441 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-4bd5d1ce-0394-4137-97df-7f43014c8013 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1522 microversion: 2.1 time: 0.162302 Feb 10 03:46:38.821009 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 531/1046] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:38 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:39.838304 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-7afb185b-9b34-4670-b022-471e5044546c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:39.838930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-7afb185b-9b34-4670-b022-471e5044546c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:39.845574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7afb185b-9b34-4670-b022-471e5044546c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:39.846021 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7afb185b-9b34-4670-b022-471e5044546c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:39.846825 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7afb185b-9b34-4670-b022-471e5044546c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:39.847259 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-7afb185b-9b34-4670-b022-471e5044546c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:39.982414 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-7afb185b-9b34-4670-b022-471e5044546c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:39.989908 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-7afb185b-9b34-4670-b022-471e5044546c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1522 microversion: 2.1 time: 0.155284 Feb 10 03:46:39.990864 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 516/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:39 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:40.926672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-188b7057-d441-4233-886c-462d1667d59a req-4d45e382-71d4-45df-ac7e-4f477d0acaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc16f9d-92be-495d-abdf-9357e248264d", "name": "network-vif-unplugged", "status": "completed", "tag": "f1a017bb-b64b-41fc-802b-4d4964557ece"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:40.928340 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:40.928340 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:46:40.936197 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-188b7057-d441-4233-886c-462d1667d59a req-4d45e382-71d4-45df-ac7e-4f477d0acaa9 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:40.936648 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-188b7057-d441-4233-886c-462d1667d59a req-4d45e382-71d4-45df-ac7e-4f477d0acaa9 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:40.948779 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.compute.server_external_events [req-188b7057-d441-4233-886c-462d1667d59a req-4d45e382-71d4-45df-ac7e-4f477d0acaa9 service nova] Unable to find a host for instance 1bc16f9d-92be-495d-abdf-9357e248264d. Dropping event network-vif-unplugged {{(pid=127952) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 10 03:46:40.949660 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-188b7057-d441-4233-886c-462d1667d59a req-4d45e382-71d4-45df-ac7e-4f477d0acaa9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027137 Feb 10 03:46:40.950589 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 532/1048] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 10 03:46:41.007260 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d0f07763-d16c-49e1-850b-180a32a6519c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:41.007898 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d0f07763-d16c-49e1-850b-180a32a6519c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:41.014541 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0f07763-d16c-49e1-850b-180a32a6519c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:41.015042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0f07763-d16c-49e1-850b-180a32a6519c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:41.015833 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0f07763-d16c-49e1-850b-180a32a6519c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:41.016279 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0f07763-d16c-49e1-850b-180a32a6519c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:41.152380 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d0f07763-d16c-49e1-850b-180a32a6519c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:41.160352 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d0f07763-d16c-49e1-850b-180a32a6519c tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1522 microversion: 2.1 time: 0.156851 Feb 10 03:46:41.160914 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 517/1049] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:41 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:42.177677 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2b8ea120-0b08-4f22-aa95-6db90968b89d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:42.178275 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2b8ea120-0b08-4f22-aa95-6db90968b89d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:42.185246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b8ea120-0b08-4f22-aa95-6db90968b89d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:42.185692 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b8ea120-0b08-4f22-aa95-6db90968b89d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:42.187183 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b8ea120-0b08-4f22-aa95-6db90968b89d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:42.187816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2b8ea120-0b08-4f22-aa95-6db90968b89d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:42.423077 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2b8ea120-0b08-4f22-aa95-6db90968b89d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:42.431450 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2b8ea120-0b08-4f22-aa95-6db90968b89d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.257348 Feb 10 03:46:42.432659 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 533/1050] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:42 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:43.431142 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-a8a6ff9b-2246-4c01-ae43-61f9b9fce39a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:43.431677 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a8a6ff9b-2246-4c01-ae43-61f9b9fce39a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:43.433644 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-9baa6c73-aba6-4e2e-a192-9e685790329f req-30384a01-8b13-452d-a48d-2f4e97c18c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a759433-8756-49d7-a4a9-eacff05a60a8", "tag": "4d591c4e-5ea2-4a7e-ad49-178e3a247434"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:43.435427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:43.435427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:46:43.438939 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a8a6ff9b-2246-4c01-ae43-61f9b9fce39a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:43.439384 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a8a6ff9b-2246-4c01-ae43-61f9b9fce39a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:43.440168 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a8a6ff9b-2246-4c01-ae43-61f9b9fce39a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:43.440590 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-a8a6ff9b-2246-4c01-ae43-61f9b9fce39a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:43.442360 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-9baa6c73-aba6-4e2e-a192-9e685790329f req-30384a01-8b13-452d-a48d-2f4e97c18c58 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:43.442834 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-9baa6c73-aba6-4e2e-a192-9e685790329f req-30384a01-8b13-452d-a48d-2f4e97c18c58 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:43.455487 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-9baa6c73-aba6-4e2e-a192-9e685790329f req-30384a01-8b13-452d-a48d-2f4e97c18c58 service nova] Creating event network-changed:4d591c4e-5ea2-4a7e-ad49-178e3a247434 for instance 7a759433-8756-49d7-a4a9-eacff05a60a8 on hv-cinder-82806 Feb 10 03:46:43.461076 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-9baa6c73-aba6-4e2e-a192-9e685790329f req-30384a01-8b13-452d-a48d-2f4e97c18c58 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030994 Feb 10 03:46:43.464524 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 534/1051] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:46:43.470181 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-e66244fd-512d-459f-bcc3-b34661f8dcd2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:43.471137 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-e66244fd-512d-459f-bcc3-b34661f8dcd2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:43.471531 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-a8a6ff9b-2246-4c01-ae43-61f9b9fce39a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Going to try to terminate instance {{(pid=127951) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:46:43.477866 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e66244fd-512d-459f-bcc3-b34661f8dcd2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:43.478830 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e66244fd-512d-459f-bcc3-b34661f8dcd2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:43.479842 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e66244fd-512d-459f-bcc3-b34661f8dcd2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:43.480461 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-e66244fd-512d-459f-bcc3-b34661f8dcd2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:43.570571 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-a8a6ff9b-2246-4c01-ae43-61f9b9fce39a tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 204 len: 0 microversion: 2.1 time: 0.142004 Feb 10 03:46:43.575014 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 518/1052] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:46:43 2022] DELETE /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:46:43.585916 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-b9c397ec-6f2b-4270-97a3-33add5832a7e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:43.587508 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-b9c397ec-6f2b-4270-97a3-33add5832a7e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:43.598971 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b9c397ec-6f2b-4270-97a3-33add5832a7e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:43.600323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b9c397ec-6f2b-4270-97a3-33add5832a7e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:43.601491 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b9c397ec-6f2b-4270-97a3-33add5832a7e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:43.602100 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-b9c397ec-6f2b-4270-97a3-33add5832a7e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:43.643072 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-e66244fd-512d-459f-bcc3-b34661f8dcd2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:43.654821 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-e66244fd-512d-459f-bcc3-b34661f8dcd2 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.188644 Feb 10 03:46:43.656099 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 535/1053] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:43 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:43.763563 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-b9c397ec-6f2b-4270-97a3-33add5832a7e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:43.772377 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-b9c397ec-6f2b-4270-97a3-33add5832a7e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1575 microversion: 2.1 time: 0.195033 Feb 10 03:46:43.773204 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 519/1054] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:43 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:44.674250 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a1bdcbe5-3411-458f-b46a-7f24ba6ab219 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:44.677221 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a1bdcbe5-3411-458f-b46a-7f24ba6ab219 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:44.685871 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1bdcbe5-3411-458f-b46a-7f24ba6ab219 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:44.686519 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1bdcbe5-3411-458f-b46a-7f24ba6ab219 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:44.689589 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1bdcbe5-3411-458f-b46a-7f24ba6ab219 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:44.690040 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a1bdcbe5-3411-458f-b46a-7f24ba6ab219 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:44.791114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-29fec1a8-40d1-425b-a69d-f5638a8dd1e3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:44.791742 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-29fec1a8-40d1-425b-a69d-f5638a8dd1e3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:44.798340 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29fec1a8-40d1-425b-a69d-f5638a8dd1e3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:44.799084 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29fec1a8-40d1-425b-a69d-f5638a8dd1e3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:44.799902 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29fec1a8-40d1-425b-a69d-f5638a8dd1e3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:44.800321 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-29fec1a8-40d1-425b-a69d-f5638a8dd1e3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:44.832926 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a1bdcbe5-3411-458f-b46a-7f24ba6ab219 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:44.840718 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a1bdcbe5-3411-458f-b46a-7f24ba6ab219 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.171925 Feb 10 03:46:44.841298 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 536/1055] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:44 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:44.944218 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-29fec1a8-40d1-425b-a69d-f5638a8dd1e3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:44.952070 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-29fec1a8-40d1-425b-a69d-f5638a8dd1e3 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1457 microversion: 2.1 time: 0.164677 Feb 10 03:46:44.952610 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 520/1056] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:44 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1457 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:46:45.862909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ed7d019c-4cc3-49d9-99ff-31f1b6b9695d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:45.864057 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ed7d019c-4cc3-49d9-99ff-31f1b6b9695d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:45.881096 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ed7d019c-4cc3-49d9-99ff-31f1b6b9695d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:45.881561 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ed7d019c-4cc3-49d9-99ff-31f1b6b9695d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:45.882375 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ed7d019c-4cc3-49d9-99ff-31f1b6b9695d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:45.882884 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ed7d019c-4cc3-49d9-99ff-31f1b6b9695d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:45.918125 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-78c799db-8d1c-48e3-91f8-4b671c56eb3f req-4525c221-c550-457f-a450-25872b2c637b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a759433-8756-49d7-a4a9-eacff05a60a8", "name": "network-vif-deleted", "tag": "4d591c4e-5ea2-4a7e-ad49-178e3a247434"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:45.919779 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:45.919779 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:46:45.928458 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-78c799db-8d1c-48e3-91f8-4b671c56eb3f req-4525c221-c550-457f-a450-25872b2c637b service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:45.929217 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-78c799db-8d1c-48e3-91f8-4b671c56eb3f req-4525c221-c550-457f-a450-25872b2c637b service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:45.941957 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-78c799db-8d1c-48e3-91f8-4b671c56eb3f req-4525c221-c550-457f-a450-25872b2c637b service nova] Creating event network-vif-deleted:4d591c4e-5ea2-4a7e-ad49-178e3a247434 for instance 7a759433-8756-49d7-a4a9-eacff05a60a8 on hv-cinder-82806 Feb 10 03:46:45.946866 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-78c799db-8d1c-48e3-91f8-4b671c56eb3f req-4525c221-c550-457f-a450-25872b2c637b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032536 Feb 10 03:46:45.950707 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 521/1057] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:46:45.974068 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d352337e-2127-45b0-981e-1ea2feb242da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:45.974791 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d352337e-2127-45b0-981e-1ea2feb242da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:45.981653 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d352337e-2127-45b0-981e-1ea2feb242da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:45.982193 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d352337e-2127-45b0-981e-1ea2feb242da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:45.983371 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d352337e-2127-45b0-981e-1ea2feb242da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:45.983895 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d352337e-2127-45b0-981e-1ea2feb242da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:46.065650 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d352337e-2127-45b0-981e-1ea2feb242da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:46.069149 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ed7d019c-4cc3-49d9-99ff-31f1b6b9695d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:46.074101 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d352337e-2127-45b0-981e-1ea2feb242da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1225 microversion: 2.1 time: 0.104904 Feb 10 03:46:46.074747 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 522/1058] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:45 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 10 03:46:46.077260 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ed7d019c-4cc3-49d9-99ff-31f1b6b9695d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.219776 Feb 10 03:46:46.078482 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 537/1059] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:45 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:47.095121 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-2c4fcc3d-e6a2-4e29-9915-5cb33ebaecc1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:47.096141 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-2c4fcc3d-e6a2-4e29-9915-5cb33ebaecc1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:47.097943 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-04e63e0b-94f3-46e3-812c-22a5cc2094c5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:47.099002 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-04e63e0b-94f3-46e3-812c-22a5cc2094c5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:47.106722 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2c4fcc3d-e6a2-4e29-9915-5cb33ebaecc1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:47.107511 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2c4fcc3d-e6a2-4e29-9915-5cb33ebaecc1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:47.108780 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2c4fcc3d-e6a2-4e29-9915-5cb33ebaecc1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:47.109135 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04e63e0b-94f3-46e3-812c-22a5cc2094c5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:47.109500 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-2c4fcc3d-e6a2-4e29-9915-5cb33ebaecc1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:47.109887 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04e63e0b-94f3-46e3-812c-22a5cc2094c5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:47.111223 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04e63e0b-94f3-46e3-812c-22a5cc2094c5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:47.111951 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-04e63e0b-94f3-46e3-812c-22a5cc2094c5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:47.178323 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-2c4fcc3d-e6a2-4e29-9915-5cb33ebaecc1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:47.186065 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-2c4fcc3d-e6a2-4e29-9915-5cb33ebaecc1 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1225 microversion: 2.1 time: 0.097011 Feb 10 03:46:47.186562 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 523/1060] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:47 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:47.273668 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-04e63e0b-94f3-46e3-812c-22a5cc2094c5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:47.281288 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-04e63e0b-94f3-46e3-812c-22a5cc2094c5 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.189478 Feb 10 03:46:47.281848 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 538/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:47 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:48.206810 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-361d4375-5766-47fe-af96-14cf52ef4693 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:48.207679 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-361d4375-5766-47fe-af96-14cf52ef4693 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:48.218373 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-361d4375-5766-47fe-af96-14cf52ef4693 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:48.219186 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-361d4375-5766-47fe-af96-14cf52ef4693 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:48.220434 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-361d4375-5766-47fe-af96-14cf52ef4693 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:48.221230 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-361d4375-5766-47fe-af96-14cf52ef4693 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:48.282075 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-361d4375-5766-47fe-af96-14cf52ef4693 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:48.290107 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-361d4375-5766-47fe-af96-14cf52ef4693 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1225 microversion: 2.1 time: 0.089488 Feb 10 03:46:48.290686 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 524/1062] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:48 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:48.297283 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-a2014c84-78cf-43c7-af4a-1eb5700b67f1 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:48.297891 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-a2014c84-78cf-43c7-af4a-1eb5700b67f1 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:48.304531 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a2014c84-78cf-43c7-af4a-1eb5700b67f1 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:48.304978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a2014c84-78cf-43c7-af4a-1eb5700b67f1 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:48.305770 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a2014c84-78cf-43c7-af4a-1eb5700b67f1 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:48.306204 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-a2014c84-78cf-43c7-af4a-1eb5700b67f1 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:48.444846 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-a2014c84-78cf-43c7-af4a-1eb5700b67f1 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:48.452328 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-a2014c84-78cf-43c7-af4a-1eb5700b67f1 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.158754 Feb 10 03:46:48.452894 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 539/1063] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:48 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:49.307519 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-cbc71daf-a736-4bf8-b40f-0d462b89074e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:49.308136 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-cbc71daf-a736-4bf8-b40f-0d462b89074e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:49.314789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cbc71daf-a736-4bf8-b40f-0d462b89074e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:49.315248 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cbc71daf-a736-4bf8-b40f-0d462b89074e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:49.316039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cbc71daf-a736-4bf8-b40f-0d462b89074e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:49.316475 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-cbc71daf-a736-4bf8-b40f-0d462b89074e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:49.385263 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-cbc71daf-a736-4bf8-b40f-0d462b89074e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:49.393005 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-cbc71daf-a736-4bf8-b40f-0d462b89074e tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 200 len: 1225 microversion: 2.1 time: 0.089513 Feb 10 03:46:49.393565 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 525/1064] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:49 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:49.469510 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-2f20bfb0-5577-42e4-bb6d-66beff18dea7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:49.470120 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-2f20bfb0-5577-42e4-bb6d-66beff18dea7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:49.477003 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f20bfb0-5577-42e4-bb6d-66beff18dea7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:49.477533 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f20bfb0-5577-42e4-bb6d-66beff18dea7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:49.478390 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f20bfb0-5577-42e4-bb6d-66beff18dea7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:49.478882 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-2f20bfb0-5577-42e4-bb6d-66beff18dea7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:49.616181 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-2f20bfb0-5577-42e4-bb6d-66beff18dea7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:49.624217 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-2f20bfb0-5577-42e4-bb6d-66beff18dea7 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.158516 Feb 10 03:46:49.624757 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 540/1065] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:49 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:50.411031 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:50.411596 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 7a759433-8756-49d7-a4a9-eacff05a60a8] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:50.418058 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:50.418505 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:50.419303 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:50.419733 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:50.432752 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] HTTP exception thrown: Instance 7a759433-8756-49d7-a4a9-eacff05a60a8 could not be found. Feb 10 03:46:50.433302 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Returning 404 to user: Instance 7a759433-8756-49d7-a4a9-eacff05a60a8 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:46:50.434177 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-bd1e36cc-100f-4635-8af0-3caeadf1a381 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8" status: 404 len: 111 microversion: 2.1 time: 0.027093 Feb 10 03:46:50.434757 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 526/1066] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:50 2022] GET /compute/v2.1/servers/7a759433-8756-49d7-a4a9-eacff05a60a8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:46:50.643364 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-67615d33-07d9-41fa-9464-7fadd5c9110f tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:50.644066 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-67615d33-07d9-41fa-9464-7fadd5c9110f tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:50.651571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-67615d33-07d9-41fa-9464-7fadd5c9110f tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:50.652028 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-67615d33-07d9-41fa-9464-7fadd5c9110f tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:50.652804 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-67615d33-07d9-41fa-9464-7fadd5c9110f tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:50.653268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-67615d33-07d9-41fa-9464-7fadd5c9110f tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:50.790287 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-67615d33-07d9-41fa-9464-7fadd5c9110f tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:50.798246 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-67615d33-07d9-41fa-9464-7fadd5c9110f tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.160021 Feb 10 03:46:50.798834 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 541/1067] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:50 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:51.815930 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d4a7e707-3dd1-4b7a-bc22-c7942bf99d46 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:51.816518 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d4a7e707-3dd1-4b7a-bc22-c7942bf99d46 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:51.823336 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4a7e707-3dd1-4b7a-bc22-c7942bf99d46 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:51.823789 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4a7e707-3dd1-4b7a-bc22-c7942bf99d46 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:51.824570 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4a7e707-3dd1-4b7a-bc22-c7942bf99d46 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:51.825010 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d4a7e707-3dd1-4b7a-bc22-c7942bf99d46 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:51.973126 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d4a7e707-3dd1-4b7a-bc22-c7942bf99d46 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:51.981511 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d4a7e707-3dd1-4b7a-bc22-c7942bf99d46 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.169581 Feb 10 03:46:51.983063 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 527/1068] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:51 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:52.999687 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-7e55c222-47ef-416a-8584-1c4afa45ed5f req-4cd1a6fa-85f5-4cd9-a67a-ad9b6b7a9a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc16f9d-92be-495d-abdf-9357e248264d", "name": "network-vif-plugged", "status": "completed", "tag": "f1a017bb-b64b-41fc-802b-4d4964557ece"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:53.000310 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-440a1e92-1d1f-48ce-8be3-8f9f6e8d7cc6 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:53.001039 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-440a1e92-1d1f-48ce-8be3-8f9f6e8d7cc6 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:53.001191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:53.001191 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:46:53.008571 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-7e55c222-47ef-416a-8584-1c4afa45ed5f req-4cd1a6fa-85f5-4cd9-a67a-ad9b6b7a9a28 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:53.009291 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-7e55c222-47ef-416a-8584-1c4afa45ed5f req-4cd1a6fa-85f5-4cd9-a67a-ad9b6b7a9a28 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:53.010367 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-440a1e92-1d1f-48ce-8be3-8f9f6e8d7cc6 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:53.010964 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-440a1e92-1d1f-48ce-8be3-8f9f6e8d7cc6 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:53.011964 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-440a1e92-1d1f-48ce-8be3-8f9f6e8d7cc6 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:53.012496 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-440a1e92-1d1f-48ce-8be3-8f9f6e8d7cc6 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:53.021586 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-7e55c222-47ef-416a-8584-1c4afa45ed5f req-4cd1a6fa-85f5-4cd9-a67a-ad9b6b7a9a28 service nova] Creating event network-vif-plugged:f1a017bb-b64b-41fc-802b-4d4964557ece for instance 1bc16f9d-92be-495d-abdf-9357e248264d on hv-cinder-82806 Feb 10 03:46:53.026995 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-7e55c222-47ef-416a-8584-1c4afa45ed5f req-4cd1a6fa-85f5-4cd9-a67a-ad9b6b7a9a28 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030998 Feb 10 03:46:53.028063 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 542/1069] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:46:53.160002 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-440a1e92-1d1f-48ce-8be3-8f9f6e8d7cc6 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:53.168298 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-440a1e92-1d1f-48ce-8be3-8f9f6e8d7cc6 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.172360 Feb 10 03:46:53.169109 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 528/1070] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:52 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:53.634978 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-3d0edb55-c2a1-48fc-9de0-79577e356914 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:53.639962 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-7e0913fd-eca6-4eb7-9c65-231660b84392 req-7d6f3069-7d69-4b4f-a332-95ef67b47225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9639e1b6-e005-4646-80c2-7d526aedf8f2", "tag": "ed384a80-1f9f-476a-b97b-aa412b2f3e8e"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:53.641589 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:53.641589 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:46:53.642206 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3d0edb55-c2a1-48fc-9de0-79577e356914 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:53.649311 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3d0edb55-c2a1-48fc-9de0-79577e356914 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:53.650016 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3d0edb55-c2a1-48fc-9de0-79577e356914 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:53.650540 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-7e0913fd-eca6-4eb7-9c65-231660b84392 req-7d6f3069-7d69-4b4f-a332-95ef67b47225 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:53.651247 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-7e0913fd-eca6-4eb7-9c65-231660b84392 req-7d6f3069-7d69-4b4f-a332-95ef67b47225 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:53.651411 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3d0edb55-c2a1-48fc-9de0-79577e356914 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:53.651858 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-3d0edb55-c2a1-48fc-9de0-79577e356914 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:53.666873 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-7e0913fd-eca6-4eb7-9c65-231660b84392 req-7d6f3069-7d69-4b4f-a332-95ef67b47225 service nova] Creating event network-changed:ed384a80-1f9f-476a-b97b-aa412b2f3e8e for instance 9639e1b6-e005-4646-80c2-7d526aedf8f2 on hv-cinder-82806 Feb 10 03:46:53.679961 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-7e0913fd-eca6-4eb7-9c65-231660b84392 req-7d6f3069-7d69-4b4f-a332-95ef67b47225 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043503 Feb 10 03:46:53.680842 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 529/1071] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:46:53.695380 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-3d0edb55-c2a1-48fc-9de0-79577e356914 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Going to try to terminate instance {{(pid=127952) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:46:53.778815 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-3d0edb55-c2a1-48fc-9de0-79577e356914 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 204 len: 0 microversion: 2.1 time: 0.147547 Feb 10 03:46:53.780091 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 543/1072] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:46:53 2022] DELETE /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:46:53.790271 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-570930e1-7393-4493-b57d-c157837d6618 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:53.791042 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-570930e1-7393-4493-b57d-c157837d6618 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:53.797293 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-570930e1-7393-4493-b57d-c157837d6618 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:53.797735 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-570930e1-7393-4493-b57d-c157837d6618 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:53.798505 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-570930e1-7393-4493-b57d-c157837d6618 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:53.798970 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-570930e1-7393-4493-b57d-c157837d6618 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:53.943037 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-570930e1-7393-4493-b57d-c157837d6618 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:53.951681 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-570930e1-7393-4493-b57d-c157837d6618 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1576 microversion: 2.1 time: 0.166892 Feb 10 03:46:53.952532 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 530/1073] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:53 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:54.186082 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-5b777351-6257-41a0-9a70-8fb699692b8d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:54.186816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-5b777351-6257-41a0-9a70-8fb699692b8d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:54.193296 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b777351-6257-41a0-9a70-8fb699692b8d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:54.193748 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b777351-6257-41a0-9a70-8fb699692b8d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:54.194527 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b777351-6257-41a0-9a70-8fb699692b8d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:54.195013 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-5b777351-6257-41a0-9a70-8fb699692b8d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:54.336600 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-5b777351-6257-41a0-9a70-8fb699692b8d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:54.344680 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-5b777351-6257-41a0-9a70-8fb699692b8d tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1578 microversion: 2.1 time: 0.162672 Feb 10 03:46:54.345618 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 544/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:54 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:54.968973 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-e6972623-a340-445f-a874-5d917de1d950 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:54.969574 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-e6972623-a340-445f-a874-5d917de1d950 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:54.976310 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6972623-a340-445f-a874-5d917de1d950 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:54.976871 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6972623-a340-445f-a874-5d917de1d950 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:54.977798 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6972623-a340-445f-a874-5d917de1d950 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:54.978284 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-e6972623-a340-445f-a874-5d917de1d950 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:55.113545 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-e6972623-a340-445f-a874-5d917de1d950 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:55.121951 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-e6972623-a340-445f-a874-5d917de1d950 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1457 microversion: 2.1 time: 0.156618 Feb 10 03:46:55.122798 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 531/1075] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:54 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1457 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:55.365687 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-57950075-6b98-4903-91bd-662b46e00352 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:55.366532 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-57950075-6b98-4903-91bd-662b46e00352 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:55.377218 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-57950075-6b98-4903-91bd-662b46e00352 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:55.377979 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-57950075-6b98-4903-91bd-662b46e00352 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:55.379326 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-57950075-6b98-4903-91bd-662b46e00352 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:55.380134 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-57950075-6b98-4903-91bd-662b46e00352 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:55.527898 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-57950075-6b98-4903-91bd-662b46e00352 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:55.535719 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-57950075-6b98-4903-91bd-662b46e00352 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1565 microversion: 2.1 time: 0.176876 Feb 10 03:46:55.536284 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 545/1076] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:55 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:56.138364 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-8ecf86ca-7110-4e80-abc5-810cb5692db7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:56.139078 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-8ecf86ca-7110-4e80-abc5-810cb5692db7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:56.145111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8ecf86ca-7110-4e80-abc5-810cb5692db7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:56.145546 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8ecf86ca-7110-4e80-abc5-810cb5692db7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:56.146322 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8ecf86ca-7110-4e80-abc5-810cb5692db7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:56.146778 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-8ecf86ca-7110-4e80-abc5-810cb5692db7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:56.293052 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-8ecf86ca-7110-4e80-abc5-810cb5692db7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1521bf93314c437798ef374963def38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9861d9e039084b9b9b24721464eea6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:46:56.302127 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-8ecf86ca-7110-4e80-abc5-810cb5692db7 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 200 len: 1457 microversion: 2.1 time: 0.167497 Feb 10 03:46:56.302709 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 532/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:56 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 1457 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:46:56.407703 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-d317aa4a-7a40-4b72-a6f3-d5b0022dd106 req-1a0669ee-bcf6-4af4-b3dd-398ea1f8f718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9639e1b6-e005-4646-80c2-7d526aedf8f2", "name": "network-vif-deleted", "tag": "ed384a80-1f9f-476a-b97b-aa412b2f3e8e"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:46:56.409227 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:46:56.409227 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:46:56.416579 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-d317aa4a-7a40-4b72-a6f3-d5b0022dd106 req-1a0669ee-bcf6-4af4-b3dd-398ea1f8f718 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:56.417022 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-d317aa4a-7a40-4b72-a6f3-d5b0022dd106 req-1a0669ee-bcf6-4af4-b3dd-398ea1f8f718 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:56.428285 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-d317aa4a-7a40-4b72-a6f3-d5b0022dd106 req-1a0669ee-bcf6-4af4-b3dd-398ea1f8f718 service nova] Creating event network-vif-deleted:ed384a80-1f9f-476a-b97b-aa412b2f3e8e for instance 9639e1b6-e005-4646-80c2-7d526aedf8f2 on hv-cinder-82806 Feb 10 03:46:56.433047 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-d317aa4a-7a40-4b72-a6f3-d5b0022dd106 req-1a0669ee-bcf6-4af4-b3dd-398ea1f8f718 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029032 Feb 10 03:46:56.433735 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 546/1078] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 10 03:46:57.318795 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:57.319387 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 9639e1b6-e005-4646-80c2-7d526aedf8f2] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:57.325670 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:57.326114 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:57.326900 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:57.327330 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:57.340531 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] HTTP exception thrown: Instance 9639e1b6-e005-4646-80c2-7d526aedf8f2 could not be found. Feb 10 03:46:57.341102 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Returning 404 to user: Instance 9639e1b6-e005-4646-80c2-7d526aedf8f2 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:46:57.341933 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-83c55ae2-4fc6-4133-b991-e21a6dfe22b6 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2" status: 404 len: 111 microversion: 2.1 time: 0.026892 Feb 10 03:46:57.342450 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 533/1079] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:57 2022] GET /compute/v2.1/servers/9639e1b6-e005-4646-80c2-7d526aedf8f2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:46:57.794344 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:57.795011 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:57.801367 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:57.801816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:57.802615 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:57.803074 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:57.821323 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.wsgi [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] HTTP exception thrown: Instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 could not be found. Feb 10 03:46:57.821961 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Returning 404 to user: Instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 could not be found. {{(pid=127952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:46:57.822879 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-b2a105f1-7572-4270-8d0f-1b1a89b657ac tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 404 len: 111 microversion: 2.1 time: 0.033180 Feb 10 03:46:57.823395 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 547/1080] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:46:57 2022] DELETE /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:46:57.831529 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:57.832111 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] [instance: 6526425c-4ed8-4fc2-982e-cfa3c75087c3] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:46:57.838049 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:57.838498 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:57.839315 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:46:57.839717 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:46:57.852469 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] HTTP exception thrown: Instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 could not be found. Feb 10 03:46:57.853072 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Returning 404 to user: Instance 6526425c-4ed8-4fc2-982e-cfa3c75087c3 could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:46:57.853860 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-309a9071-0559-4a61-9d24-5b3035f674da tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3" status: 404 len: 111 microversion: 2.1 time: 0.026211 Feb 10 03:46:57.854351 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 534/1081] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:46:57 2022] GET /compute/v2.1/servers/6526425c-4ed8-4fc2-982e-cfa3c75087c3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:46:59.163582 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-592cf2cc-5360-459f-881c-053a9a6d6104 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] Calling method '.version_select at 0x7fe95ab1ddc0>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:46:59.188455 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-592cf2cc-5360-459f-881c-053a9a6d6104 tempest-TestVolumeBootPattern-1471660300 tempest-TestVolumeBootPattern-1471660300-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1051863551" status: 202 len: 0 microversion: 2.1 time: 0.028509 Feb 10 03:46:59.189041 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 548/1082] 10.222.0.32 () {58 vars in 1262 bytes} [Thu Feb 10 03:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1051863551 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:47:16.395439 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:47:16.396269 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: Thu Feb 10 03:47:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 10 03:48:09.765426 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d789a2b3-a10a-4af0-874d-7f6264281adc tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:48:09.766061 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d789a2b3-a10a-4af0-874d-7f6264281adc tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:48:09.772343 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d789a2b3-a10a-4af0-874d-7f6264281adc tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:09.772788 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d789a2b3-a10a-4af0-874d-7f6264281adc tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:09.773566 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d789a2b3-a10a-4af0-874d-7f6264281adc tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:09.773999 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d789a2b3-a10a-4af0-874d-7f6264281adc tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:09.800038 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d789a2b3-a10a-4af0-874d-7f6264281adc tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Going to try to terminate instance {{(pid=127951) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 10 03:48:09.881278 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d789a2b3-a10a-4af0-874d-7f6264281adc tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 204 len: 0 microversion: 2.1 time: 0.120498 Feb 10 03:48:09.882372 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 535/1083] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Feb 10 03:48:09 2022] DELETE /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 10 03:48:09.892477 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-d0019821-7dfa-43ee-a359-42929303187b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:48:09.893169 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-d0019821-7dfa-43ee-a359-42929303187b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:48:09.906216 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0019821-7dfa-43ee-a359-42929303187b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:09.907005 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0019821-7dfa-43ee-a359-42929303187b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:09.907967 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0019821-7dfa-43ee-a359-42929303187b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:09.908956 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-d0019821-7dfa-43ee-a359-42929303187b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:09.962693 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [req-0fc766d4-03e6-421e-b675-11c9b1b65b7a req-ed75cc5b-95ea-46d0-86f3-873488cd37ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc16f9d-92be-495d-abdf-9357e248264d", "tag": "f1a017bb-b64b-41fc-802b-4d4964557ece"}]} {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:48:09.964279 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:48:09.964279 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: warnings.warn(msg) Feb 10 03:48:09.972402 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-0fc766d4-03e6-421e-b675-11c9b1b65b7a req-ed75cc5b-95ea-46d0-86f3-873488cd37ad service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:09.972860 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [req-0fc766d4-03e6-421e-b675-11c9b1b65b7a req-ed75cc5b-95ea-46d0-86f3-873488cd37ad service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:09.983060 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.compute.server_external_events [req-0fc766d4-03e6-421e-b675-11c9b1b65b7a req-ed75cc5b-95ea-46d0-86f3-873488cd37ad service nova] Creating event network-changed:f1a017bb-b64b-41fc-802b-4d4964557ece for instance 1bc16f9d-92be-495d-abdf-9357e248264d on hv-cinder-82806 Feb 10 03:48:09.989364 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [req-0fc766d4-03e6-421e-b675-11c9b1b65b7a req-ed75cc5b-95ea-46d0-86f3-873488cd37ad service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220184 Feb 10 03:48:09.990670 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 549/1084] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:48:10.153577 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.policy [None req-d0019821-7dfa-43ee-a359-42929303187b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127951) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:48:10.161328 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-d0019821-7dfa-43ee-a359-42929303187b tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1571 microversion: 2.1 time: 0.274533 Feb 10 03:48:10.162202 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 536/1085] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:48:09 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1571 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:48:11.182174 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-d45b8349-c4b8-4eb7-9968-848d09cfdcdb tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:48:11.182909 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-d45b8349-c4b8-4eb7-9968-848d09cfdcdb tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:48:11.189628 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d45b8349-c4b8-4eb7-9968-848d09cfdcdb tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:11.190080 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d45b8349-c4b8-4eb7-9968-848d09cfdcdb tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:11.190902 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d45b8349-c4b8-4eb7-9968-848d09cfdcdb tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:11.191338 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-d45b8349-c4b8-4eb7-9968-848d09cfdcdb tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:11.384268 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-d45b8349-c4b8-4eb7-9968-848d09cfdcdb tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:48:11.392099 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-d45b8349-c4b8-4eb7-9968-848d09cfdcdb tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1452 microversion: 2.1 time: 0.215406 Feb 10 03:48:11.392671 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 550/1086] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:48:11 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:48:12.224911 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [req-f59d803e-107e-4fef-8efc-039b63f50453 req-88f61293-0f26-45c4-997c-7961fcdf0c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc16f9d-92be-495d-abdf-9357e248264d", "name": "network-vif-deleted", "tag": "f1a017bb-b64b-41fc-802b-4d4964557ece"}]} {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 10 03:48:12.226581 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 10 03:48:12.226581 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: warnings.warn(msg) Feb 10 03:48:12.233684 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-f59d803e-107e-4fef-8efc-039b63f50453 req-88f61293-0f26-45c4-997c-7961fcdf0c53 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:12.234129 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [req-f59d803e-107e-4fef-8efc-039b63f50453 req-88f61293-0f26-45c4-997c-7961fcdf0c53 service nova] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:12.245507 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.compute.server_external_events [req-f59d803e-107e-4fef-8efc-039b63f50453 req-88f61293-0f26-45c4-997c-7961fcdf0c53 service nova] Creating event network-vif-deleted:f1a017bb-b64b-41fc-802b-4d4964557ece for instance 1bc16f9d-92be-495d-abdf-9357e248264d on hv-cinder-82806 Feb 10 03:48:12.250227 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [req-f59d803e-107e-4fef-8efc-039b63f50453 req-88f61293-0f26-45c4-997c-7961fcdf0c53 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091708 Feb 10 03:48:12.250899 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 537/1087] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Feb 10 03:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 10 03:48:12.413391 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-ece7c9a1-02df-4279-a6b1-8985e64247bd tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:48:12.413942 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.compute.api [None req-ece7c9a1-02df-4279-a6b1-8985e64247bd tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127952) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:48:12.419984 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ece7c9a1-02df-4279-a6b1-8985e64247bd tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:12.420427 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ece7c9a1-02df-4279-a6b1-8985e64247bd tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:12.421249 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ece7c9a1-02df-4279-a6b1-8985e64247bd tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:12.421672 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG oslo_concurrency.lockutils [None req-ece7c9a1-02df-4279-a6b1-8985e64247bd tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:12.486196 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.policy [None req-ece7c9a1-02df-4279-a6b1-8985e64247bd tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87291059637f46ca8985768611d1acf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1b85d278c49969a6a638dd37579d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127952) authorize /opt/stack/nova/nova/policy.py:199}} Feb 10 03:48:12.495211 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-ece7c9a1-02df-4279-a6b1-8985e64247bd tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 200 len: 1220 microversion: 2.1 time: 0.087739 Feb 10 03:48:12.495876 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 551/1088] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:48:12 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 10 03:48:13.513163 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '>' {{(pid=127951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:48:13.513812 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.compute.api [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] [instance: 1bc16f9d-92be-495d-abdf-9357e248264d] Fetching instance by UUID {{(pid=127951) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 10 03:48:13.520497 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:13.520945 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:13.521709 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 10 03:48:13.522212 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Lock "9e5db6ec-3f2c-49f5-9851-3e8c38c287f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 10 03:48:13.535460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.wsgi [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] HTTP exception thrown: Instance 1bc16f9d-92be-495d-abdf-9357e248264d could not be found. Feb 10 03:48:13.536040 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: DEBUG nova.api.openstack.wsgi [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Returning 404 to user: Instance 1bc16f9d-92be-495d-abdf-9357e248264d could not be found. {{(pid=127951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 10 03:48:13.536867 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO nova.api.openstack.requestlog [None req-fbee3ef9-8e93-4748-a158-7973bde9c0de tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d" status: 404 len: 111 microversion: 2.1 time: 0.028270 Feb 10 03:48:13.537360 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: [pid: 127951|app: 0|req: 538/1089] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Feb 10 03:48:13 2022] GET /compute/v2.1/servers/1bc16f9d-92be-495d-abdf-9357e248264d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 10 03:48:13.699914 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: DEBUG nova.api.openstack.wsgi [None req-12593cb2-ab00-4ed8-9cb5-3cf5f8c728c4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] Calling method '.version_select at 0x7fe95a1f15e0>' {{(pid=127952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 10 03:48:13.719816 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO nova.api.openstack.requestlog [None req-12593cb2-ab00-4ed8-9cb5-3cf5f8c728c4 tempest-TestShelveInstance-309755371 tempest-TestShelveInstance-309755371-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1741087814" status: 202 len: 0 microversion: 2.1 time: 0.023559 Feb 10 03:48:13.720879 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: [pid: 127952|app: 0|req: 552/1090] 10.222.0.32 () {58 vars in 1253 bytes} [Thu Feb 10 03:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1741087814 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 10 03:48:50.959460 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:48:50.960403 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: Thu Feb 10 03:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 10 03:50:26.516569 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:50:26.517407 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: Thu Feb 10 03:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 10 03:50:36.407770 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:50:36.408537 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: Thu Feb 10 03:50:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 10 03:50:48.345369 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:50:48.346473 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: Thu Feb 10 03:50:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 10 03:50:49.292734 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:50:49.293624 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: Thu Feb 10 03:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 10 03:52:10.972364 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:52:10.972978 dv-cinder-828060-2-iscsi devstack@n-api.service[127951]: Thu Feb 10 03:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 10 03:52:14.399826 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 10 03:52:14.400478 dv-cinder-828060-2-iscsi devstack@n-api.service[127952]: Thu Feb 10 03:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!